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RADIO RESEARCH AND APPLIED 
PSYCHOLOGY 


Introduction by the Guest Editor 


This volume contains a number of studies stemming from an 
effort to make psychology serve a practical purpose. The 
papers, all related to radio problems, do not answer material 
questions ; they report how psychologists have gone about seek- 
ing these answers. As such, they would seem to fulfill very 
well the definition of ‘‘applied psychology’’ as the sum total 
of techniques used by psychologists when they are called upon 
to collaborate with agencies empowered to perform specific 
social functions. 

Observers agree that a new field of research, related to the 
operation of radio broadcasting, is being delineated. This field 
of radio research presents three important opportunities to 
psychologists: challenging problems, unusual data, and more 
jobs. It seems worthwhile to sketch this territory where stu- 
dents will have a chance to stake a claim if they understand 
its ‘* geography. ” 

Anyone who uses radio for some purpose is concerned with 
the question of how to increase its effectiveness. The educator, 
the advertiser, the entertainer, the molder of public opinion, 
all want to convey a message, and so they are all faced with the 
following standard set of problems. 

1. To what degree are people ready to accept the message? 

2. What is the best specific form in which to put it on the 
air? 

3. With what potentialities and limitations must we reckon, 
if we use radio, rather than another medium of communi- 
cation ? 

4. To what extent has our message reached its mark? 
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2 INTRODUCTION 


These four questions have many ramifications, but only a 
few can be outlined here to indicate the psychologist’s place in 
the search for their answers. 


PEOPLE AND PROGRAMS 


1. For whatever goal radio is used, we shall want to know 
first to what extent people are prepared to fall in line. There 
is a direct and an indirect way to find out about people’s 
‘*needs,’’ as far as a radio message is concerned. In a direct 
approach we might use attitude measurements, value tests, or 
similar devices which permit us to appraise the demand for a 
new toothpaste, serious chamber-music, or the preservation of 
democratic institutions. Indirectly, we can start with appro- 
priate interpretations of actual broadcasting experiences. 
There are successful and unsuccessful programs continually 
on the air, from which the psychologist can single out those 
which seem to be related to the topic of his interest. What, in 
terms of the listeners’ needs, acevants for this success or fail- 
ure? What gratification do people get from listening to differ- 
ent kinds of programs? Answers to these questions will fur- 
nish leads for the successful use of radio for other purposes; 
or, if our purpose is to show people how to use radio to their 
own advantage, we shall be able to detect detrimental use, or 
discover new areas of gratification in which the potentialities 
of this new instrument have been overlooked. 

Two marginal problems seem especially important. If some 
people do not make the best use of radio, it might be because 
they are not trained to listen as they are to read. Listening 
tests, similar to the reading tests used for classification and 
improvement of reading abilities will have to be developed. 
On the other hand, if we find little preparedness for the mes- 
sage to be conveyed, the necessity to create ‘‘needs’’ arises. 
This is a question of psychological experiment, but of course, 
at the same time, it is a moral responsibility corresponding to 
the actual purpose the psychologist is supposed to serve. 

2. Since radio reaches the public through individual pro- 
grams, program research becomes a major unit of the new 
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field. Here, again, the starting point will be the study of the 
success or failure of existing programs, but now in terms of 
the features of the broadcast accounting for its reception by 
the listener. From this point the psychologist will proceed to 


' the testing of programs before they are put on the air. There 


might be a mutual give and take between copy testing of 
printed advertisements and program testing, but radio will 
have to develop methods of its own in order to take care of its 
peculiar problems. For example, a majority of radio pro- 
grams have a serial character, a number of comparable single 
broadcasts being linked together as a major unit in time. This 
necessitates the use of listener panels, meaning that repeated 
interviews will have to be conducted with the same people. 

The techniques of program research are just beginning to 
develop. We may tentatively expect the following groups of 
problems : 

(a) What will be appropriate indices for describing listener re- 
actions to a program as a whole? 

(b) To what extent are listeners able to distinguish the features 
of a program which account for their preference, and by what ex- 
perimental devices can we help them to be more analytical in their 
appraisals? 

(¢) How can we check the validity of ajprogram test? That is, 
how can we be sure that following suggestions resulting from such 
a test will really make the program more successful? 

(d) How can we get people to participate in listener panels, 
making certain that they are representative of the desired audience 


at the beginning, and that they do not become psychologically less 
representative as time goes on? 


CONDITIONS AND EFFECTS 


3. As a tool of communication, radio has a number of char- 
acteristics which differentiate it from other media with which 
it must compete or cooperate. Any specific use of radio will 
have to take this into consideration. For the purpose of prac- 
tical application, as well as research, it is helpful to speak of 
‘*eontradictions,’’ to indicate that radio has a set of assets 
which in turn can become liabilities. Three examples will be 
given as suggestions for further elaboration. 
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(a) The auditory character of radio makes it a powerful means 
of arousing emotions through the use of sound effects, the human 
voice, ete. At the same time, this auditory character might make 
it very difficult to keep a radio presentation on the level of clear 
thinking and rational exposition of problems. 

(b) Radio extends beyond geographical boundaries and into the 
privacy of homes with ease; as a result, it can reach more people 
quickly than has ever been done before. But at the same time it 
can easily be shut off, and if people are not present when a message 
is relayed, then it is gone without leaving any trace. 

(¢) Radio, as it is now operated, places a premium on centraliza- 
tion; it strives to serve geographically large areas, and large num- 
bers of people simultaneously. This policy brings it into conflict 
with the rather firmly established psychological notion that influ- 
ences are more effective when tied up with existing ‘‘frames of 
reference’’ such as local flavor, special interests, and recent 
experiences. 


These ‘‘contradictions’’ will have to be studied carefully for 
their application to any practical purpose. What is useful for 
advertising might be a handicap for education ; radio might be 
most powerful when it ties in with subsidiary media like news- 
papers or local organizations, and might be quite wasteful if it 
has to create its own audience. 

4. To know whether radio has been successful in a specific 
ease, whether the original mark has been reached, is equally 
important to the sponsoring agencies and to the psychologist 
who learns from past experiences how to do better the next 
time. There is both a positive and a negative aspect to this 
group of questions. 

From the positive side, we desire to know whether people 
listened to the broadcast, whether they liked it, and whether 
they reacted in the expected manner. The measurement of 
audience size is fairly well worked out, although the methods 
in use still require further detached scrutiny. Whether the 
program was liked or not will probably be studied with tech- 
niques rather similar to those necessary for program testing. 
The most serious challenge confronting the psychologist comes 
from consideration of what people did or felt as a resalt of the 
influences brought to bear upon them over the radio. New 
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ways of using questionnaires will have to be developed as well 
as a skilled use of inferential indices, such as sales figures, data 
on voting, ete. 

From the negative side, the study of ‘‘non-listening’’ might 


. come to be considered important. People who are technically 


available might not listen because they do not even know about 
the broadcast. Finding these people by appropriate research 
is necessary for the planning of subsidiary promotion. A sec- 
ond group of ‘‘non-listeners’’ are those who are set against a 
certain type of program. They refuse to listen to ‘‘high- 
brow’’ stuff, or they don’t like dramatizations, or they offer 
other objections. In concrete practice a compromise will be 
necessary between the purpose of the broadcaster and this kind 
of general resistance brought to light by research. Finally, 
there is the group who are willing to give the broadcast a fair 
trial, but find it unsatisfactory because they dislike it to begin 
with, or because they got too much of it. This last group, it is 
felt, offers the kind of listening dissatisfaction which would 
be an especially sensitive indicator for the guidance of specific 
radio efforts. 


RADIO RESEARCH IN ITS LARGER CONTEXT 


The set of problems just sketched belongs at the intersection 
of two more general scientific pursuits. The one is the study 
of the social implications of broadcasting. The operation of 
radio certainly bears the imprint of the present social system 
and is, in turn, bound to have certain effects upon social insti- 
tutions. On the one hand, what is or is not going on the air is 
greatly influenced by the respect for existing moral codes, the 
acceptance of today’s distribution of property, and other fea- 
tures of American culture. The study of radio could even 
serve as a way to the better understanding of some basic issue 
in our society. On the other hand, radio as an institution will 
gradually bring about changes in the circulation of news- 
papers, the prevailing system of teaching in the schools, and 
so forth. Such problems call for study by sociologists, econo- 
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mists, anthropologists, and have, at the same time, their psycho- 
logical side. But this is not the place to do more than mention 
a much needed cooperation of all the social sciences. 

From a second point of view, the psychological aspect of 
radio research ties in with comparable studies in other areas 
of social concern. The improvement of business management, 
the prevention of crime, the promotion of civic participation, 
are a few fields of endeavor where a very characteristic type 
of study has developed. The pattern is always the same: a 
certain effect upon people is to be achieved; how far different 
groups of individuals are prepared to undergo this influence 
must be appraised; the probable effectiveness of special mea- 
sures is to be pre-tested ; the appropriateness of different tools 
of influence is to be scrutinized; and actual effects are to be 
measured and explained. This is precisely the type of research 
as it has just been outlined in relation to radio. We should 
not be surprised if a discipline of ‘‘action research’’ should 
evolve one day, bringing out more clearly the great methodo- 
logical similarity of many studies which now are not connected 
because they are done under different headings such as Crimi- 
nology, Market Research, or Accident Prevention. Inciden- 
tally, this implies that the student might sometimes have to 
investigate how radio could be made less effective in cases 
where social considerations demand the counteracting of some 
radio influence. 

A final word should be said about why it is believed that 
psychologists should be concerned with radio research when 
there has never been much talk about magazine research or 
movie research and their relation to psychology. There are 
three reasons for such a trend of thought. Broadcasting has 
grown very rapidly, without time to build up a tradition as 
have other media; there were small newspapers closely in 
touch with their readers long before the large newspaper 
chains of our day developed. Then, too, radio is isolated from 
its public more than any other medium of communication ; the 
movies have box office receipts; magazines have circulation fig- 
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ures; but radio has no such natural indicator of its success. 
Finally, broadcasting is organized in a few large units, and so 
decisions are probably made more rationally, and expenses for 
research felt less severely. All this would lead to the expecta- 


‘tion for quite a future in a field such as the one sketched in the 


preceding pages. 

Whether the psychologist will get his share of this develop- 
ment will depend mainly upon whether his instruments prove 
satisfactory. He has a well developed inventory of indices, 
questionnaires, tests and experimental setups, and he will have 
to show that they are useful for the purpose of those who want 
to make radio more effective. The present issue of the Journal 
of Applied Psychology purports to show that this is indeed 
the case, while at the same time it would like to stimulate 
further efforts. 

















Section I. Index Problems 

Editorial: The bulk of the papers in this entire issue has been 
furnished by the Princeton Radio Research Project, which is 
described among the progress reports included in the fifth 
section. From the major units outlined, special methodological 
experiences have been selected and re-grouped for technical dis- 
cussion. This section contains those papers which deal with the 
problem of how to describe people’s attitudes to radio as a whole, 
special program items, or commercial advertisements, in simple 
summarizing indices. The last paper strikes a note, which re- 
sounds throughout the volume, that often various indices can 
equally serve the same purpose. 


AN INDEX OF ‘“‘RADIO-MINDEDNESS’”’ AND 
SOME APPLICATIONS 


FRANCIS OLLRY anp ELIAS SMITH 
Princeton Radio Research Project 


CONSTRUCTION OF THE INDEX 


OR many practical purposes in radio research, it is neces- 
fF sary to judge what radio means to different groups of 
people. Do they feel an active, participating interest, or 

only a detached interest of no personal importance? An index 
of what we call ‘‘radio-mindedness’’ might be developed in 
many ways. One might construct elaborate attitude tests, but 
the many complications involved in such a procedure would 
mnilitate against their employment. One could use estimates of 
the amount of listening on the day preceding the interviews, but 
since only about 50 per cent of a sample is likely to have listened 
on a specific evening, the data would be incomplete. Ranking a 
number of listed leisure-time activities could be tried, but since 
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in many cases we should be asking respondents to compare radio 
listening with other hobbies they do not cultivate at all, the psy- 
chological meaning of the rankings might not be comparable. 

The index finally decided upon and discussed in this paper was 


‘obtained through a combination of answers to two questions.* 


1. If you had to give up radio, would you miss it: 
A BOOK Mea) eeecennn Somewhat... cence Fk + = 
2. To what programs do you usually listen in the course of the week? 


The answer to the first question is a simple statement of the 
respondent’s attitude toward radio. We must note, however, 
that the answer might be influenced by the interviewee’s ver- 
bal habits and how he distinguishes ‘‘a good deal’’ from 
**somewhat.’’ In analyzing the second question, we assume 
that people who are more radio-minded are likely to remember 
more programs. On the other hand, memory loss not neces- 
sarily related to the attitude, as well as laziness in replying, 
might influence the number of programs mentioned. The two 
questions, however, serve as mutual checks and afford us a 
three-step index which is easily handled. 

To derive this index we divide the group into those who 
mention three programs or less and those who mention four 
programs or more, and into those who would miss the radio a 
good deal and those who would miss it only somewhat or not 
at all. The results are given in Table 1. 


TABLE 1 
Relation of Number of Programs Mentioned to Attitude toward Radio 














Number of programs mentioned 
How radio would be missed Tt Four Total 
or less or more 
Somewhat or not at all ..................... 729 285 1014 
A good deal 557 832 1389 
Total 1286 1117 2403 








1 These questions appeared in a study on reading and listening made in 
cooperation with the Book-of-the-Month Club. A random sample of 2403 
members of this club was taken in 90 cities. 
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As could be expected, there is a high association between the 
replies to the two questions. We might call the persons in the 
upper left corner the detached listeners, persons in the lower 
right, the responsive listeners. Members of the remaining two 
groups have an attitude toward radio which does not permit 
our classifying them either as responsive or detached. They 
can be considered an intermediate group.” 

These three groups, classified by our index of ‘‘radio-mind- 
edness,’’ are distributed as follows: 


TABLE 2 
Distribution of Sample 





Persons interviewed 





Number Per cent 


Group I. Responsive Listeners—those who hear 

four or more usual weekly programs 

and who would miss radio a good deal 832 35 
Group II. Intermediate Listeners—those who 

either hear four or more weekly. pro- 

grams or would miss radio a good deal, 

but not both 842 35 
Group III. Detached Listeners—those who usually 

hear less than four weekly programs 

and who would miss radio either some- 

what or not at all 729 30 











Total Interviewed 2403 100 








2 It would be possible to carry the analysis of this middle group further. 
One could assume that those who would miss radio a good deal but know 
only a few programs form an enthusiastic but selective group of listeners, 
whereas those who know many programs but would not miss radio much 
are forced to radio listening by outside factors, such as their family, 
although they do not care for it themselves. This distinction might be 
important from different points of view. For our present purpose, how- 
ever, it can be overlooked because what we are interested in is an index 
which permits our selecting groups which are beyond a doubt either re- 
sponsive or detached listeners, in order to see what other differences these 
two groups show. 
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CONSISTENCY OF THE INDEX 
To test the consistency of this index, we divided our groups 
according to their replies to other questions related to their 
attitude toward radio. Table 3 gives the results in answer to 
the question : ‘‘ When you are tired do you like best to read .......... : 
to listen to the radio ........... , other ........... e”* 











TABLE 3 
Relation between ‘‘ Radio-Mindedness’’ and Preferred Activity 
When Tired 
Index of ‘‘ radio-mindedness’’ Total 
Preferred activity ‘ number 
Responsive Intermediate Detached 
a 39.3% 52.7% 67.5% 1237 
Radio listening ....... 37.5% 25.3% 10.7% 591 
| TS 23.2% 23.0% 21.8% 538 
_ aA e 100.0% 100.0% 100.0% 
ea isadetahiptsitice . 820 829 717 2366 





Since the study was made with Book-of-the-Month Club 
members, a selection factor probably operates here to make 
reading the preferred activity for all groups, but there is, 
nevertheless, a marked correspondence between the index of 
‘*radio-mindedness’’ and the inclination to give radio as a 
preferred activity when tired. 

The attitude of the groups toward alternate sources of ob- 
taining news was studied. The replies to the following ques- 
tion are given in Table 4: ‘‘In general, do you prefer to learn 


TABLE 4 
Relation between ‘‘ Radio-Mindedness’’ and Preferred News Source 














Index of ‘‘ radio-mindedness’’ Total 
Preferred source . . aunties 

Responsive Intermediate Detached 

0 Bee are 45.4% 58.1% 82.0% 1455 

BIE Gass. ncrccheateaciechinns 40.0% 29.5% 10.6% 655 

Reading and radio... 12.6% 10.4% 3.7% 218 

Other 2.0% 2.0% 3.7% 59 
Total 100.0% 100.0% 100.0% 





Base 827 836 724 2387 
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about news through reading ........... , through listening to the radio 
alsi , other ........?”” 

The relation between ‘‘radio-mindedness’’ as measured by our 
index, and preference for radio as a source of news is about 
the same as the one exhibited in Table 3. 

The following question was also asked : 

‘*Has anything you’ve heard on the radio—previews, dramatiza- 


tions, or talks—ever prompted you to read about a subject men- 
tioned ?’’s 


Here, again, we find that the receptiveness to the suggestions 
which come over the radio is highly related to the index of 
‘*radio-mindedness.”’ 
TABLE 5 
Relation between Index and Receptiveness to Suggestion 





Index of Per cent 








‘‘radio-mindedness’’ influenced -=—«-T*al eases 
Responsive neem 31.8 818 
Intermediate i cccccccccnnn 22.4 781 
Detached 18.3 718 
Total 21.0 2317 








It appears, then, that this index is consistent with other 
questions bearing on the attitude toward radio. In the fol- 
lowing discussion we shall illustrate the use of this index in 
relation to: (1) Group differences; (2) Psychological deaf- 
ness; and (3) Cultural level of listening. 


Group Differences 


Applying our index to such group characteristics as age and 
sex, we find that women are more responsive listeners than 
men. 

Age differences are still clearer. Older people are more 
likely to belong to the detached rather than to the responsive 
group of listeners. 

8 This question will be discussed in detail in another report, Alberta 


Curtis, Reading and Listening, A monograph in preparation for the Prince- 
ton Radio Project. 
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TABLE 6 
Relation between ‘‘ Radio-Mindedness’’ and Sex 

















Sex 
Index 

Male Female 
ee 27.0% 38.2% 
Intermediate ccc " 36.5% 34.4% 
Detached 36.5% 27.4% 
Total 100.0% 100.0% 
Base 721 1622 








TABLE 7 
Relation between ‘‘ Radio-Mindedness’’ and Age 











A 
Index .. Total | 70tal 
27-younger 28-42 43-older 
Responsive ........... 41.2% 34.2% 27.9% 100.0% 812 
Intermediate .......... 33.2 36.9 33.4 100.0 823 
Detached ................ - 25.6 28.9 38.7 100.0 708 
J “ 100.0 100.0 100.0 2343 





It must be kept in mind that our age classification is a rough 
one. We might find more ‘‘radio-mindedness’’ when we reach 
the highest age groups where many retired people could be 
found. On the other hand, we might make finer distinctions, 
for example, among women according to the age of their child- 
ren. Generally, however, the information implied in the pre- 
ceding table should be of practical importance. 

It so happens that in our sample there is a correlation be- 
tween age and sex. The women are on the average somewhat 
younger than the men. As women and younger people are 
much more responsive, it seemed worthwhile to separate those 
factors. 

Table 8 shows ‘‘radio-mindedness’’ for people above and 
below thirty-seven years of age, separated according to sex. 

It is easily seen that the age distinction holds true regardless 
of sex, although for women the decrease of ‘‘radio-minded- 
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TABLE 8 
Relation between ‘‘ Radio-Mindedness’ and Age-Sex Combinations 
Female Male 
Index 
837 0rless 38ormore 37orless 38 or more 
BeSPOMsive ne ceccennnnm sles 44.2% 28.8% 32.1% 21.0% 
Intermediate cnn 39.2% 27.2% 34.4% 39.0% 
Detached 16.6% 44.0% 33.5% 40.0% 
Total 100.0% 100.0% 100.0% 100.0% 
Base 328 393 639 983 








ness’’ with increasing age is greater. The sex difference too 
becomes even more obvious as far as people below 38 are con- 
cerned. For the older age group, clear-cut differences between — 
men and women can no longer be found. In general, we find 
that older people are less “‘radio-minded’’ than younger, this 
being more marked among women than among men. This may 
be the result of a tendency to lose interest in radio as one 
grows older, or it may follow from the newness of radio to 
older people, who have grown up in pre-radio times. If de- 
crease in radio-mindedness is related to the process of growing 
older, we still do not know whether this indicates decreasing 
interest in leisure-time activities in general, or whether this 
decrease is a specific change in attitude toward radio.‘ 


Psychological Deafness to Radio 


A question has been raised about the number of persons who 
turn the radio on without really listening to it. Are there 
psychologically deaf groups of radio listeners, just as there 
are people who disregard the noises of the city? Several mea- 
sures of psychological deafness are conceivable, one of them be- 
ing the association between actual listening and radio-minded- 

4 There is a further possibility that this result is due to our sample; our 
older respondents may be particular in that they are interested in reading 
and are members of book clubs. A comparison with other material, how- 
ever, summarized in the last section of this issue, seems to corroborate the 
decline of radio listening with age. 
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ness. If there is much listening by people who do not care for 
radio, psychological deafness could be inferred. This associa- 
tion can be measured for about half the subjects covered by the 
study because only that many listened to the radio the previous 
evening. In the following table the respondents are grouped 
according to the amount of time they spent listening the eve- 
ning preceding the study. Each of these groups is re-divided 
according to the index of ‘‘radio-mindedness.’’ 


TABLE 9 
Relation between ‘‘ Radio-Mindedness’’ and Evening Listening 


Time listened Index of ‘‘ radio-mindedness’’ 





Total Total 








0 
"aubing Responsive Intermediate Detached neuher 
- 4 hou ..W.. 23.7% 46.8% 29.5% 100.0% 169 
- 1% hours ........... 39.8 37.6 22.6 100.0 314 
— 23 hours ............. 44.6 36.2 18.2 100.0 340 
~ 34 hours ............. 59.0 27.7 13.3 100.0 166 
+34 hours ............. 66.0 28.6 5.4 100.0 112 





The table shows that the proportion of responsive listeners 
increases sharply with the amount of actual listening and the 
proportion of detached listeners decreases accordingly. As 
far, then, as the data show, not much psychological deafness 
ean be found. One might call those who listen more than 14 
hours but have a detached attitude toward radio psychologi- 
cally deaf. Eight per cent would be classified in this category. 
It would be important to make personal interviews with people 
who belong in this group and to study in detail what accounts 
for this contradiction between actual behavior and attitude. 
Furthermore, it might be worthwhile to repeat such a study 
from time to time with comparable groups in order to see 
whether the amount of deafness is increasing as radio becomes 
more and more an established institution. 


** Radio-Mindedness’’ and Cultural Level of Listening 


In another form, the preceding result can be formulated to 
show a strong association between ‘‘radio-mindedness’’ as an 
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attitude and actual listening. The question comes up as to 
whether the content of the programs most frequently listened to 
is also different for listeners with different attitudes. Of all the 
programs mentioned as favorites by the respondents, a certain 
number can be characterized as ‘‘cultural,’’ for lack of a more 
descriptive word. All good music, forums and discussions, news 
commentators, and programs sponsored by educational insti- 
tutions have been included in this group. Our purpose was 
to characterize the program list of each respondent according 
to the number of cultural and intellectual interests exhibited. 
The people were divided into those whose lists included a ma- 
jority of such cultural programs, and into those most of whose 
programs were of non-cultural character. Roughly, a third of 
the respondents belong to the first group, two-thirds to the 
second.® 

The relation of ‘‘radio-mindedness’’ to quality of listening 
can be seen in the following table. 

















TABLE 10 

Relation between ‘‘ Radio-Mindedness’’ and Quality of Listening 

Average level of Index of ‘‘ radio-mindedness’’ 

listener to usual Total 

programs Responsive Intermediate Detached 
Cultural programs prevail- 
ing 25.6% 30.6% 48.3% 763 

Other programs prevailing 74.4% 69.4% 51.7% 1367 
Total 100.0% 100.0% 100.0% 
Base 832 774 523 2129 








The table clearly shows that responsive listeners listen on a 
relatively lower level than the detached listeners. 


5It might seem surprising that a third of our sample claim that the 
majority of their preferred programs are on such a high level. The 
reader will have to remember that our sample consists of a selected group, 
inasmuch as they are all members of a book club. In addition, there is 
probably the usual distortion toward a higher level of listening. These 
factors, however, are not of importance in connection with this report 
because what we are interested in is the relation between ‘‘ radio-minded- 
ness’’ and level of listening. 
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There are two ways to interpret this result. First, we should 
remember that what we called cultural programs occupy only 
a small part of all the radio time available. Therefore, if 
someone listens to the radio a great deal as a preferred form of 
leisure-time activity, he is forced to include ‘‘non-cultural 
programs’’ in his radio diet. Many of the responsive listeners 
might listen to more cultaral programs if there were more 
available. 

One might argue, however, that persons who listen mainly to 
cultural programs do not like to listen too much to the radio 
under any circumstances, because they want to spend some of 
their leisure time in other activities. It is probably an inter- 
relation between the supply and demand factors which will, 
upon further research, account for the result of the preceding 
table. The test might consist of ascertaining whether in areas 
with more cultural programs there is on the whole more radio 
listening among those who care for cultural programs. 


SUMMARY 


We have developed, then, an index of radio-mindedness 
which seems sensible and shows consistency with the answers 
to a series of questions implying an attitude toward radio. 
We have then applied this index to three questions: group 
differences in radio-mindedness, association between radio- 
mindedness and actual listening, and association between 
radio-mindedness and cultural level of listening. We found 
that men are less radio-minded than women and older people 
less than younger people. There exists a strong positive asso- 
ciation between radio-mindedness and actual listening which 
leads to the inference that there is little psychological deafness 
prevalent toward radio. The more radio-minded people are, 
the less interested they are likely to be in cultural programs. 

It is evident that such an index can be used to study quite 
a number of further problems. Are radio-minded people more 
susceptible to promotion by radio than by other media? Are 
radio-minded people, in spite of the lower cultural level of 
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their listening, more likely to accept education over the air 
than in other forms? For these and similar problems this 
index might prove valuable. 


A COMPARISON OF VARIOUS RATING SCALES 
USED IN JUDGING THE MERITS OF 
POPULAR SONGS 


G. D. WIEBE 
Princeton Radio Research Project 


THE ORIGIN OF THE DATA 


N a study on the popularity of song hits, an opportunity was 
given to compare three different ratings. One hundred 
seventy-five university and high school students expressed 

their opinions on 24 songs which were played to them on the 
piano. The students were first asked to rate the songs on a 
ten-point scale. Then they were furnished with the informa- 
tion that a similar study had been done with musical experts 
connected with broadcasting companies. The students were 
also asked to fill in the questionnaire used by these experts, 
which contained two other questions on the reaction to these 
songs. The two sheets were printed on different sized and 
separate pages so that the whole setup of the situation made the 
filling in of the second questionnaire a unit of action separated 
from the first answer. Asa result it caused no particular con- 
cern when the students were, in one case, asked for similar 
reactions on the two questionnaires. 

Thus we have the replies by the same people, regarding the 
same songs on the following three questions. 

(a) Ten-point rating. In preparation for rating the songs 
on ten-point scales, the instructions were as follows: ‘‘On the 
first page of your questionnaire you will see six ten-point 
scales. We are to hear six popular tunes, and one ten-point 
scale is to be used in rating each tune. Place your check 
where you think it should be in order to indicate your general 
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impression of the song. If you like the song very much, your 
check will probably be near the end of the scale which is num- 
bered ten. If you check at ten, you mean that you like the 
song very much. You think it is one of the best. If you 
‘check at zero, you indicate that you dislike this song. You 
consider it very poor.’’ 





/ 
0 2 4 / 6 8 10 
I dislike This is I like this 
this song; just song very 
it is very average much ; it is 
poor one of the 


best 


(b) Prediction of success. The instructions to the student 
concerning the ‘‘success item’’ were as follows: ‘‘ Imagine that 
you are a program builder in a large radio station when you 
answer this item. After you hear each song, try to decide 
whether it will be a success with the general public. Indicate 
your opinion by checking in one of the four blank spaces.”’ 

Do you think this song will be: A great success 
An average success 

No special success 

Have no opinion 





l 





(The songs used in this experiment were new and had not yet 
been released for general use.) 
(ec) Second question on likes and dislikes. Inserted in the 
experts’ questionnaire was the item: 
**Do you personally like this song? 
Yes—— Neutral No-——?’’ 





This question did not require any special instructions or dis- 
cussion. 

In order to make the replies to those three questions com- 
parable, the following procedures were used : 

(a) For the ten-point scale the average rating for each song 
was computed directly from the information given by the re- 
spondent. These mean ratings varied from 2.5 to 8.4 with a 
median of 6.4 and an interquartile range 7.6 to 5.6. 
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(b) In tabulating the responses to the success item, a great 
success was given a value of 3. An average success was given 
a value of 2. No special success was given a value of 1. Have 
no opinion was given a value of 0. Here the range varied be- 
tween 1.1 and 2.7 with a median of 2.0 and an interquartile 
range of 2.4 to 1.8. 

(c) For the second question on likes and dislikes, the pro- 
portion of people answering ‘‘Yes,’’ they liked a song per- 
sonally, was used as a numerical index. The proportion of 
approvals varied from 10 per cent to 90 per cent with a median 
of 64.2 and an interquartile range of 78.2 to 41.0. 

As a result of those computations, a table of scores for the 
24 songs was set up. The first few lines read as follows: 








TABLE I 
Average Judgments According to Three Indices on Certain 
Popular Songs 
Four-step 
Ten-point Proportion 
Titles rating scale Porvem eae t of approvals 
Who Blew out the Flame ........... 5.1 1.6 31% 
A Song from Old Hawaii ....... 2.5 11 10% 
Loomdom Bridge ee ccccccceeeceeesoe 5.1 2.0 32% 
Heart and Soul ...................... 8.1 2.7 90% 
Two Sleepy People ...................... 6.1 18 64% 








eteeee eeeeee 





RATING AND PREDICTION OF SUCCESS 


The ten-point rating and the success prediction differed in 
three respects. The one was supposed to be an expression of 
subjective action and the other an objective appraisal of the 
song’s future popularity. The one question asked for an ex- 
pression in graphic numerical form, whereas the other used 
verbalized distinctions. The one permitted the expression on 
a ten-point ranking, whereas the other gave only four possi- 
bilities. In spite of these differences, the rank order correla- 
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tion between the two indices, as far as these 24 songs go, is .90. 
Evidently, the answers to the two questions for the average 
subject mean about the same thing irrespective of the objective 
differences just enumerated.* 


AVERAGE RATING AND FREQUENCY OF APPROVAL 


It is sensible to assume that the larger the score in the aver- 
age rating of a song according to the ten-point scale question, 
the larger would be the portion of the group saying ‘‘ Yes,’’ in 
response to the question : ‘‘Do you personally like this song?’’ 
If more people like it, it is probable that the average subject 
likes it more. For practical purposes, however, it is important 
to learn how high this correlation is. If the personal prefer- 
ence question (c) gives about the same results as the ten-point 
rating scale according to question (a), the former would be 
preferable because it is so much easier to handle. As our 
study shows, the correlation is exceedingly high. If we rank 
the 24 songs once according to the average rating and once 
according to the proportion of approving listeners, then the 
coefficient of rank correlation is .94.? 

As a by-product it is interesting to look at the average rat- 
ings for each song, separated according to whether the respon- 
dent likes the song, dislikes it or feels neutral. Table II gives 
the grand average rating of all the songs by these three groups 
of people. 


1In only one song out of the twenty-four did the two scales appear to 
present widely different rank. The song is entitled ‘‘London Bridge is 
Falling Down.’’ It borrows heavily from the traditional nursery rhyme 
tune. It seems probable that the students thought the associations with 
childhood plus the recent phenomenal reception of ‘‘A Tisket a Tasket,’’ 
would make this song a general success although they did not rate it high 
in their own opinion. The difference in rank here was eight points—the 
song being ranked as number 12 in order of predicted success and as 
number 20 in order of introspective opinion. If this song is dropped 
from the list, the correlation between the rank order of the two scales 
becomes .92. 

2 As a consequence of this result and the result of the preceding sec- 
tion, you would expect the success rating and the proportion of approvals 
to correlate highly. As a matter of fact, the correlation is .87. 
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TABLE II 
Answer to Question (c) and Corresponding Mean Scores on 
Ten-point Scale 
Likes the song 7.8+1.6 
Feels neutral §.2+1.6 
Dislikes the song 1.7+1.7 








It is interesting to note that the neutral reaction and the 
middle of the rating scale coincide for all practical purposes. 
The rating distance between ‘‘ Dislikes the song’’ and ‘‘ Feels 
neutral’’ is greater than the rating distance between ‘‘ Likes 
the song’’ and ‘‘Feels neutral.’’ This fact deserves further 
investigation. In our special study the songs were liked so 
well that the number of ‘‘no’’ ratings is in general rather 
small and as a result the figure 1.7 is hardly reliable. 


CONCLUSIONS 


When high school and university students judge popular 
songs, the results from 


1. A four-point scaie calling for an objective sort of judg- 
ment to be expressed by checking a verbal response 
shows a rank order correlation of .9 with a ten-point 
rating scale calling for a subjective sort of judgment 
to be expressed in terms of numerical ratings. 

2. The rank order of the mean ratings on the ten-point 
scale for each song shows a rank order correlation of 
.94 with the rank order of the proportions of the sam- 


ple expressing liking for each song. 

3. The mean success predictions in terms of the four-point 
scale show a rank order correlation of .87 with the pro- 
portions of the sample expressing liking for each song. 

It might be questioned whether the results here reported 

would be applicable to other kinds of material besides songs, 
for instance, commercials or whole radio programs. The cor- 
relations we obtained are so high that it is at least permissible 
to formulate the following hypothesis: If subjects are in an 
evaluative attitude regarding some presented material, there 
exists a wide range of rating devices by which practically the 
same rank order of the evaluated objects can be obtained. 
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A COMPARISON OF THREE INDICES OF 
ATTITUDE TOWARD RADIO 
ADVERTISING 


JEANETTE SAYRE 
Princeton Radio Research Project 


INCE the American system of broadcasting depends upon 

advertising for its very existence, it is of great impor- 

tance to know the reaction of the listening public to the 
commercials the advertisers send forth over the air to adver- 
tise their products. In any attitude study a number of differ- 
ent measurements can be used. It is obviously a decisive 
question whether the different techniques which can be used 
lead to the same results. In the specific field of attitude toward 
radio advertising, several studies have been conducted in the 
past with little or no attempt at correlation between the vari- 
ous techniques used. We have singled out for study here the 
two indices currently used, and shall add a third—an attitude 
scale. , 

The first of the previously used techniques is an estimate of 
time consumed by advertising on the radio. It was concluded 
that those people who overestimated the time on the radio taken 
up by advertising must dislike the advertising because, being 
bored or annoyed, they would tend to think it lasted longer 
than was actually the case.” 

The second previously used technique is a question which 
has been asked in the following way: ‘‘ Would you be willing 
to pay a small tax (about $2.00 a year) to have the same pro- 
grams you have now, only without the advertising?’”® If the 
respondent would be willing to pay such a tax, it was con- 
cluded that he disliked advertising. 

The attitude scale was developed according to Likert’s pro- 


1 For survey, see A. Kornhauser, Attitude Measurement in Radio 
Research, in Educational Broadcasting 1937, 244-248, 250-252. 

2 H. Cantril and G. Allport, The Psychology of Radio, 1935, 246. 

8 Ibid., p. 103. 
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cedure.* The respondent was asked to mark statements con- 
cerning radio advertising, ‘‘strongly agree,’’ ‘‘agree,’’ ‘‘ uncer- 
tain,’ ‘‘disagree,’’ or ‘‘strongly disagree.’’ The extreme re- 
action to each statement indicating approval of advertising 
was marked ‘‘5,’’ while the opposite was marked ‘‘1.’’ The 
total of the scores for each question constituted the individ- 
ual’s score on the scale. 

The most usable form for the three indices was worked out 
in a pre-test of 50 cases. In order to check whether the two 
first techniques actually measured like or dislike for radio ad- 
vertising, certain additional information was secured. Since 
the estimate of time consumed by commercials might vary 
‘with the person’s ability to estimate any unit of time, the inter- 
viewer asked the respondent to estimate also the length of time 
the interview lasted, and compared this guess with the actual 
time clocked on a stop-watch. An elaboration of the question 
on license fee was made in order that the re.pondent should 
understand that the fee would change the whole relation of 
broadeasting and advertising. In addition, certain other 
checks were used to be sure the results were valid. Half of the 
questionnaires had the question on license fee first, and half of 
them had the question on estimated radio time first, to see 
whether the sequence of the questions made any difference in 
the results.® 


«BR. Likert, ‘‘ Technique for the measurement of attitudes,’’ Archives of 
Psychology, No. 140, 1932. 

5 The effect of filling in the questionnaire in a group as opposed to filling 
it in privately was studied in a special test in which questionnaires given 
in a psychology class were compared with an equal number of question- 
naires given to students privately. Although the number of respondents 
is too small to do more than indicate trends, it is interesting that the score 
for the attitude scale averaged 2.9 for the class and 2.4 for students tested 
individually. We had expected from conversation with students that they 
would be opposed to radio advertising, and that they would be more 
opposed to it than ever when answering in a group. The opposite, how- 
ever, is the case, perhaps because of the desire of the respondent questioned 
individually to impress the interviewer with his radicalness on this point. 
There were no other differences in results on other questions. 




















~~ 
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THE SAMPLE 


The study was conducted in the Forest Hill area of Newark, 
New Jersey, chosen because it contains a relatively high per- 
centage of native-born, English-speaking people, and also be- 
cause several income groups could be found here in a relatively 
compact part of the city. The interviewer went to each house 
on both sides of the street, using the two forms of the question- 
naire alternately. She reported that her reception was about 
equally good from both the higher- and lower-class homes, for 
while there was some difficulty in getting past the maids in the 
higher income groups, the women in lower income levels were 
often annoyed at being disturbed at their work.® 

Three hundred and two interviews were obtained. About 
245 people refused to answer the questionnaire, and about 485 
were not at home. Care was taken that the sample should be 
representative of several age, sex, and income groups. If the 
interviewer reported an undue proportion of people in any one 
income level, she was asked to concentrate her efforts for the 
next few days on sections where people of different income 
levels lived. Toward the end of the interviewing, it was de- 
cided that the proportion of men was low, and the interviewer 
accordingly concentrated on evening interviews when she 
would be more likely te find the men at home. The interviews 
with men were difficult to obtain since so few of them were at 
home during the day, and they were not very cooperative 
about being interviewed at night. 

6In another study done at the same time in a comparable section of 
Newark, it was discovered that the rate of refusal was significantly differ- 
ent for high and low income groups in the morning and afternoon. For 
the high income groups, 36 per cent of the refusals were in the morning 
and 64 per cent in the afternoon; while in the lower income groups, 61 per 
cent of the refusals were in the morning and 39 per cent in the afternoon. 
This seems to be explained by the fact that women in higher income levels 
are more apt to be busy socially in the afternoon than are the women in 
low income levels, and that the latter are less willing to be disturbed in 
the mornings at their work than are the former. This general conclusion 


on interviewing experience is corroborated by the interviewer for this 
study. 
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The final distribution of the estimated age in the sample is 











as follows: 
Age Number of cases 
Less than 25 50 
25-39 111 
40-54 94 
55 and over 44 
Unknown 3 
Total 302 





It was most difficult to see that several different income 
groups were represented in the sample, as there are so few 
‘‘upper-class’’ homes in Newark, and refusals here cut down 
the available number to a considerable degree. Income was 
ascertained by requesting the respondent at the end of the in- 
terview to check one of the following classifications as repre- 
senting that for his family. The scale presented to him was a 
linear arrangement of the income classifications listed below. 

The income distribution of the sample is as follows: 





Family income Number of cases 


Less than $1999 
$2000-2999 
$3000-3999 
$4000-5999 
$6000-8999 
$9000-14000 
Over $15,000 
Unknown 





eran SSB S 





Total 302 





There is a correlation of only .20 between age and income, 
showing that there is no significant lumping of people in any 
age group in any income class. 

Our sample, then, consists of : 302 people living in Newark, 
New Jersey, three-fourths women and one-fourth men, a few 
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over half of the group being under 39 years of age, and a few 
less than half being over 39. A few more than half came from 
homes with an income of less than $3,000 and a few less than 
half came from homes with an income of more than $3,000. 
All cooperated reasonably well with the interviewer. 


THE ATTITUDE SCALE 


Each of the ten questions on the attitude scale had five pos- 
sible grades of answers, from ‘‘strongly agree’’ to ‘‘strongly 
disagree.’’ They were scored from 1 to 5, with the answer 
most likely to be given by a person liking advertising on the 
radio counted as five and the opposite end of the scale scored 
as one. The lowest possible total score on the attitude scale, 
then, was 10, indicating dislike of radio advertising. The high- 
est possible score on the attitude scale was 50, indicating ap- 
proval of radio advertising. Dividing the total score by 10, 
the number of questions, we obtained the average score for 
each question. The distribution of the average score for the 
total group is as follows: 











Average score Number of cases 
1,0-1.4 3 
1.5-1.9 9 
2.0-2.4 22 
2.5-2.9 63 
3.0-3.4 89 
3.5-3.9 90 
4.0-4.4 26 
Total 302 





We found a few people who were violently opposed to radio 
advertising, but none who were strongly for it. The average 
score, 3.24, is .24 degrees higher than the hypothetical average 
of the scale, showing that the group interviewed was not so 
opposed to radio advertising as had been expected from 
previous studies. 

The following statements made up the battery used ; the scale 
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items : 


1. Advertising of new products on the air is often interesting. 
Strongly Strongly 
Agree Agree Undecided Disagree Disagree 
Radio advertising is just an annoying interlude in most programs. 
Radio advertising should not be allowed on the air. 
Advertising of men’s (women’s) articles is annoying. 
(answer for the opposite sex) 
It is interesting to listen to advertising from a well-known company. 
Radio advertising seldom tells the truth about an article. 
All advertising should be left out of educational programs. 
Advertising on the radio is so repetitious that it is boring. 
Radio advertising is tolerated because the only alternative is to shut 
off the radio. 
10. Radio advertising is enjoyable because it takes less effort to learn 
about a product over the air than any other way. 


accompanying the first item was added to each of the other 


» 9 


oman an 
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LICENSE FEE 


The question on license fee reads as follows: ‘‘Most 2% the 
European countries do not have advertising on the radio. 
This is, of course, only possible where a country asks each 
owner of a radio to pay a license fee in order to cover expenses 
for programs that are here sponsored by certain companies. 
How much would you be willing to pay each month in order 
to have the programs you have now without the advertising?’’ 
0 10¢-25¢ 26¢-50¢ 51¢-61.00 $2.00 $3.00 $4.00 $5.00 


An overwhelming majority of the people interviewed would 
pay nothing at all.’ Of the 302, 78 per cent would pay nothing, 


7 The findings of this study are corroborated by two studies done inde- 
pendently. One reported by Cantril and Allport in Psychology of Radio, 
page 103, states that 24 per cent of the people interviewed would be 
**willing to pay a small tax (about $2.00 a year) to have the same pro- 
grams they have now only without advertising.’’ A similar study con- 
ducted by Market Analyst, Inc., at the Trenton State Fair, showed that 
26.1 per cent of those interviewed would ‘‘pay a small fee of $5.00 per 
year if all advertising were eliminated from the radio.’’ These results 
are not strikingly different from the result here that 22 per cent would 
be willing to pay a fee. 
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12 per cent would pay 10c—25c, 3 per cent would pay 26c—50c, 
3 per cent would pay $2.00, and only one person would pay 
$5.00. Three per cent refused to answer the question. The 
wording of the question caused some difficulty since a few of 
the people commented: ‘‘Since I do not like the programs we 
have now on the radio, I would not pay anything io have more 
like them with or without the advertising.’’ It is not known 
how often this interpretation occurred. 

There is some association between willingness to pay a license 
fee and score. The average score of those who would pay a 
fee is 2.74 + .044, while the average score of those who would 
not pay a fee is 3.31 + .078. Those who are more opposed to 
radio advertising would be more likely to consider paying a 
fee than those not so opposed. 


ESTIMATE OF TIME CONSUMED BY ADVERTISING ON THE RADIO 


The question concerning radio advertising reads as follows: 
‘Will you please estimate as best you can how much time on 
the average fifteen-minute program is taken up with commer- 
cial advertising? _............ minutes.’’ The answers to this ques- 
tion varied from one to ten minutes, with a large group of 
people guessing three, five, and seven minutes. The distribu- 
tion of the guesses is as follows: 











Estimated radio minutes 
5-2.4 2.5-4.4 4.5-6.4 6.5-8.4 8.5-10 Unknown Total 
Number of cases ...... 32 99 126 29 11 5 302 





It is evident that the majority of people over-estimated widely 
the time taken up by commercials. 

The score on the attitude scale and the estimate of time con- 
sumed by commercials are not closely associated. Below is the 
average attitude score for different estimates of time consumed 
by commercials. 





Estimate of time consumed by commercials (minutes) 
Less than 5 5 More than 5 
Average attitude score... 3.28 3.17 2.98 























30 JEANETTE SAYRE 


Thus, although those guessing the smaller amounts of time 
have on the average a more favorable attitude toward adver- 
tising as measured by the attitude scale, and although the score 
is progressively lower as the estimate of time goes up, never- 
theless the differences are not striking. There is even less 
association between the estimate of commercials and unwilling- 
ness to pay a license fee. The information on this association is 
seen below: 





Estimate of time consumed by commercials (minutes) 





Less than 5 5 More than 5 


Per cent willing to pay a 
gs 18 16 26 








Here the per cent willing to pay a fee does not increase directly 
as the estimate of time consumed by commercials increases, but 
rather seems to have little relation to the estimate of time, al- 
though more of the people who widely over-estimate time of 
commercials would be willing to pay than is the case in any 
other group.® 

The practical conclusion from the results of these experi- 
ments can only be drawn hesitantly. There is no way to de- 
cide which of the three indices is the true or the best yardstick. 
Common sense will lead us to assume that the attitude scale 
might express fairly well the respondent’s reaction to commer- 
cial advertising; there is no special reason why people should 
try to deceive either themselves or others on such a topic which 
is not very important to them. If that can be assumed, then 

8 In order to check whether estimates of time consumed by commercials 
varied with the individual’s ability to judge any length of time, we asked 
the respondents to estimate how long the interview had lasted, and then 
compared the estimate with the actual time as clocked by the interviewer 
on a stop watch. This revealed there was no significant correlation be- 
tween estimates of commercials and estimates of the length of the inter- 
view. It is possible that people do not judge time in the abstract, but the 
particular event which happened in the interval. Factors of boredom or 
interest would enter here. This ability to judge time should be investi- 
gated further. 
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our experiment shows that neither the money nor the time 
index, both of which have been used in previous studies, is an 
adequate measure for attitude towards commercial advertising. 
The time index will be disqualified because it has practically 
no correlation with the attitude test. The money index has a 
satisfactory correlation but so few people would be willing to 
pay any license fee that this index only permits the measuring 
of extremely negative attitudes. It therefore remains a chal- 
lenge for further research to find better indices in this field 
to substitute for those used so far but proven ineffective in 
this report. 


APPENDIX 


I. The question can be raised whether those three indices al- 
though not correlating highly among themselves could not still 
be used interchangeably when it comes to measuring the rela- 
tion between attitude toward commercial advertising and 
other variables.° 

The information gathered by our questionnaire permits the 
comparison of the attitudes of different income groups, different 
age groups, and the two sexes. As the following table shows, 
the three indices do not vary in the same direction. The differ- 
ences, however, are so small that never are all three of them 
statistically reliable. Therefore, this table remains inconclusive 
rather than precludes the interchangeability of those indices. 
For a final answer, it would be necessary to relate those three 
attitude measurements to a variable implying greater diffi- 
culties. 

II. In order to discover what effect, if any, the order of the 
questions had on the answers, half of the questionnaires were 
given with the question on license fee first, and half with the 
question on estimating time consumed by commercials first. 
It was found that the form of the questionnaire made some 
difference in the results: The attitude score was slightly 
affected by the order of the questions. When the question on 

® For the general problem, see the last paper in this section. 
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Averages for the Three Indices for Different Sex, Income, and Age Groups 





Average attitude Average time Per cent 





estimate f 
soore te for wags es pay 

Sex 
RIE ~ scetitinnitnintiinais 3.05 4.2 34.7 
TOU . ciriistishisiibinn 3.25 4.6 13.2 

Income 

Less than $3000 .. 3.16 4.5 17.6 
$3000 and over .. 3.21 44 20.7 

Age 
Under 39 ................. 3.19 4.3 23.0 
40 and over ............. 3.27 4.8 14.1 





estimating radio time came first, the average score was 
3.17 + .05, while the average for the form with the question on 
license fee first was 3.22 + .05. It seems probable that when 
people are impressed with the fact that they would have to 
pay some direct fee in order to change the radio advertising 
system, they would be more likely to overlook certain things 
they have held against radio advertising than if they answered 
that attitude scale without this consideration in mind. It may 
be that this question causes them to think first of both the 
pros and cons of our advertising system and be less naive in 
their reactions than if they were just asked at first how long 
they think commercials last on the radio. 

Form also influences the results of the question on estimat- 
ing time consumed by commercials. When the question on 
money is given first the average estimate is 4.56 + .01 minutes, 
while for the one with the radio time estimated first the aver- 
age is 4.77 + .01 minutes. 

It seems probable that again the question on license fee 
makes the respondent think, ‘‘ Well, advertising is not so bad 
after all, considering what it would cost me not to have it,’’ 
and therefore he estimates less time than he would otherwise. 

As far as the question on license fee itself goes, it seems to 
make little difference whether it is asked at the beginning or 
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at the end of the interview; in fact, only two people more said 


that they would be willing to pay on one form than on the 
other. 

The differences have no influence upon the topic discussed in 
this paper. It is interesting, however, to see how careful one 
ought to be with the interpretation of any attitude measure- 
ment. The mere fact of making people aware by implication 
that the fight against commercial advertising might mean pay- 
ing a license fee, immediately improves their attitude toward 
commercials perceptibly, whether it is measured by the attitude 
scale or by the time estimate. 


INTERCHANGEABILITY OF INDICES IN THE 
MEASUREMENT OF ECONOMIC 
INFLUENCES 


P. F. LAZARSFELD 
Princeton Radio Research Project 


THE PROBLEM 


NCIDENTAL references in a number of recent papers sug- 
gest that often similar answers will be obtained to a problem 
of social research even though yardsticks used to measure 

the factors involved differ from each other. In other words, 
indices which might not correlate completely with each other 
may have practically the same correlation with a third variable. 
For example, Smith made a study’ comparing the way people 
actually spend their leisure-time with an average estimate of 
the leisure-time activities given by the same people at the be- 
ginning of the study. Smith finds an average correlation of 
only +.50 to +.70 between the estimated and the actual time 
budget. His own summary shows, however, that if he charac- 
terized the leisure-time activities of his group of eighty subjects 
by a graphical profile, he would get nearly the same results 


1M. Smith, ‘‘An Experiment to Test the Reliability of Estimates of Use 
of Time,’’ Journal of Applied Psychology, 22, 1988, 400-407. 
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whether he used the estimates or the time actually spent. The 
rank correlation between the two series of leisure-time data 
is .98. Jenkins points out? that if housewives are interviewed 
twice about their last purchases, 10 to 15 per cent of the women 
change the name of the brand from one interview to another; 
the total distribution of brands mentioned, however, remains the 
same because the individual changes cancel each other. 

The present writer* found, in a study of milk-drinking habits 
of children, that the number of glasses the children claimed they 
usually drink per day was somewhat higher than the number of 
glasses they reported having consumed the day preceding the 
study. When it came to measuring the decrease of milk drink- 
ing with age, however, practically the same decrease of 25 per 
cent between the ages of fourteen and eighteen was found, irre- 
spective of whether consumption was measured by the index 
‘‘drinks usually’’ or ‘‘drank yesterday.’’ 

These incidental observations suggest a more careful analysis 
of the interchangeability of indices, a matter which this paper 
purports to exemplify in the field of measuring economic status. 


THE STRUCTURE OF SIMPLE INDICES OF ECONOMIC STATUS 


In listener research as well as in other fields of social and mar- 
ket research, the question of how to describe the economic status 
of a respondent has been frequently discussed. The actual 
amount of family income is probably, by and large, the best 
yardstick of the economic status of a group of people as long as 
they live in approximately the same area. When it comes to 
comparing the Middle-West and the East, and larger and 
smaller communities, however, differences in local standards of 
living and in prices might make the same monetary income indi- 
cative of a difference in purchasing power. In addition, it is 
often psychologically difficult to ask a man what his income is, 


2J. G. Jenkins, ‘‘Dependability of Psychological Brand Barometers. 
I. The Problem of Reliability,’’ Journal of Applied Psychology, 22, 1938, 
1-7. 

8 E. F. Brown and P. F. Lazarsfeld, Milk Drinking Habits among Young 
People, Milk Research Council, 1938. 
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and the reply may not always be trustworthy. Therefore, two 
substitutes for income figures have been developed and have 
been used widely. 

One substitute is the intuitive rating done by the interviewer. 
It is assumed that a trained investigator, imbued with the social 
standards of his community and well instructed by his super- 
visor, would be able to use ratings like A, B, C, or D, which make 
his impressions comparable with those of another investigator 
and reliable for comparing one study to another.‘ 

The other substitute consists of using certain indicative items 
such as home ownership, car ownership, the possession of certain 
technical facilities such as telephone and refrigerator, or the 
exercise of certain privileges such as paying income taxes or 
belonging to certain clubs and associations.’ A special example 
of this approach is the use of a respondent’s occupation as an 
index of economic status.° Since there is no convenient term 
for this procedure corresponding to the term ‘‘intuitive rat- 
ings,’’ we shall use the term ‘‘ economic characteristics’’ to refer 
to items such as the above by which we can classify respondents. 

For our present purpose three surveys have been selected as 
examples: a regular nationwide poll of the American Institute 
of Public Opinion made in October, 1937, and covering about 
three thousand cases; a regular nationwide poll made for 
Fortune magazine in April, 1938, covering five thousand cases ; 

4It would be an interesting and worthwhile topic of a special study to 
find out how different research agencies instruct their field staff in allocat- 
ing those ratings and what evidence they have as to their reliability and 
comparability. 

5 We shall not discuss the question of measuring cultural differences on 
the same economic level which would be measured, for instance, by owner- 
ship of books or concert attendance or similar indices. What in sociology 
is called the measurement of social status is somewhere between those cul- 
tural measurements and what we call here economic status. A very instruc- 
tive summary of these efforts is given by M. J. McCormick, A scale for 
measuring social adequacy. Social Science Monographs, 1, 1930, No. 3. 

6 This approach has been especially developed by a group of students in 


Minnesota. See K. H. Baker, ‘‘Radio Listening and Socio-economic 
Status,’’ Psychol. Rec., 1, 1937, 99-144. 
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and a survey made of about 1,500 families in Fort Wayne, In- 
diana, conducted by McFadden Publication in 1936. We are 
indebted to those three agencies for giving us access to their 
original material. 

As might be expected, the different economic characteristics 
used are associated one with another, but the association is not 
at all complete. In the McFadden survey, for instance, the 
following association between home-ownership and car-owner- 
ship exists. 





Ownshome Does not own home Total 


OWS CAT once seeneseevnccreree 574 426 1000 
Does not own car ......... 231 246 477 
Total 805 672 1477 











To get a very rough measure of this association, observe that 
56 per cent of the respondents in the sample would be char- 
acterized in the same way whether they are judged by car-own- 
ership or home-ownership. The rest would belong to different 
groups according to which characteristic is used. 

Somewhat similar figures are obtained from the other two 
surveys. The sample of the American Institute can be char- 
acterized according to telephone-rental and car-ownership. The 
original figures show that 68 per cent of the respondents would 
belong to the same group whichever of the two characteristics 
were used. The Fortune survey permits a classification accord- 
ing to whether respondents own their homes and whether some- 
one in the immediate family of the respondent pays an income 
tax. According to the original figures, 46 per cent of the 
sample would be rated the same by either of these two economic 
characteristics. 


EXAMPLES OF INTERCHANGEABILITY OF INDICES 


If a comparison between intuitive ratings and economic char- 
acteristics is attempted, a difficulty arises since the ratings 
usually are made in three to five steps, whereas the character- 
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istics permit a division into only two classes, those who ‘‘have 
it,’’ and those who ‘‘don’t have it.’’ It is possible, however, 
to reach some comparability by combining two characteristics 
into one index. Taking the Fortune survey as an example, 
we might classify the respondents according to whether they 
own a home and pay income tax, whether they own a home or 
pay income tax (but not both), and whether they neither own a 
home nor pay an income tax. This process of combining the 
boxes of a two-dimensional table to form a one-dimensional 
three-step scale will be referred to as ‘‘reduction.’”’ The intui- 


-tive ratings, on the other hand, even if they are graded in four 


or more steps, can be arbitrarily combined into three steps. 
Thus, since the Fortune survey, for instance, used four ratings, 
A, B, C, D, the ratings B and C may be combined into one 
middle group. 

As a result, we get two indices of three steps each, which can 
be compared in the same way as the characteristics with two 
steps were compared above. An example is the following table 
where the sign + or — is used to indicate whether a characteristic 
does or does not apply. (This notation will be followed all 
through this paper.) 





Ownership of car Intuitive ratings 








and paying of Total 
income tax A BandC D 
Re EE a 280 654 55 989 
tno 142 1543 324 2009 
OF i caitastetengellunttiionth 16 949 494 1454 
, ESN 438 3146 873 4457 





This time 52 per cent of all the cases involved would belong 
in the same class irrespective of the yardstick used. In the 
survey of the American Institute of Public Opinion, the intui- 
tive rating can be tabulated against a combination of car and 

7 For a more elaborate discussion of this operation of reduction, see 


P. F. Lazarsfeld, ‘‘Some Remarks on Typological Procedure in Social Re- 
search,’’ Zeitschrift fiir Sozialforschung, 1937. 
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telephone ownership, and in this case 66 per cent of the group 
would be rated alike regardless of which of the two measure- 
ments is used. 

The rest of this paper will be confined to a comparison of such 
three-step indices arrived at either by intuitive ratings or by 
combinations of economic characteristics, as mentioned above. 
The thesis which we intend to defend is that for a certain type 
of problem it does not make much difference which of these 
measures of economic status is used. The type of problem we 
have in mind is one in which the main interest does not lie in 
describing the economic status of the respondents for its own 
sake, but in which the stress is laid upon measuring the effect 
of the economic status upon habits, preferences, and attitudes. 
The situation then is similar to the examples given at the begin- 
ning of this paper. Although indices may not correlate highly 
one with another, they may have a very similar correlation with 
a third variable. For the sake of convenience, the term ‘‘eco- 
nomic influence’’ will be used to connote the association between 
economic status and certain psychological features. We claim, 
then, that the economic influence upon certain psychological 
variables can be measured by a number of different indices of 
economic status and the result will be much the same irrespec- 
tive of the economic status index used. In other words, for the 
measurement of economic influence, different indices of eco- 
nomic status are often interchangeable. 

In the survey of the Institute of Public Opinion the respon- 
dents were asked for whom they had voted in 1936. The intui- 
tive ratings used by the Institute are from top to bottom: Av +, 
Av, P +, P, OR (Av standing for average, P for poor, and OR 
for on relief). If we combine those ratings into three groups 
we get the following proportion of Landon votes: 








Status Per cent for Landon 
Av+, Av 42.5 
P+ 21.7 
P, OR 15.9 























MEASUREMENT OF ECONOMIC INFLUENCES 39 


Now we can measure the social status of the same respondents 
by dividing them, as we have seen, into those who own a car 
and a telephone (++), those who own a car or a telephone 
(+-, -—+), and those who own neither (--—). What is the pro- 
portion of Landon votes in those three groups? 








Status Per cent for Landon 
“> 40.2 
+-, —+ 28.0 
-- 15.3 





The last two tables show a surprising agreement. For prac- 
tical purposes the economic influence upon the political vote in 
1936 is equally well described by each of these yardsticks, al- 
though, as we have seen above, the agreement between the two 
indices themselves is far from complete.* 

The Fortwne survey data permit an interchange of a three- 
step intuitive rating and a three-step index gained from a 
reduction of two economic characteristics, ownership of a home 
and paying of income tax by the immediate family of the re- 
spondent. The psychological variable upon which economic 
influence is measured is obtained from the answers to the ques- 
tion, ‘‘Do you listen to classical music on the air?’’ With 
decreasing economic status, there is a steady decline in the 
proportion of people who answer ‘‘yes.’’ In the following 
table, this decline is exhibited in two columns. In the first 
column, status is measured by the intuitive rating, and in the 
second column by the home—income tax index. 

The two indices here are indeed interchangeable. The slope 
of the decline, which is a measure of economic influence upon 


8 In terms of the two preceding tables, the concept of ‘‘ economic influ- 
ence’’ can now be formulated more precisely: It corresponds to the average 
differences between the proportion of Landon voters in the three economic 
status groups. The greater those differences, the more marked is the eco- 
nomic influence. This interpretation applies to the other examples in the 
text. 
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Per cent of listeners to classical music 








Status Status measured by Status measured b 
intuitive rating home-income tax ~ 
SEA Scasecheinicnbeei 77.5 76.7 
Middle .................. 63.7 61.6 
on 51.1 53.7 





interest in classical music, is practically the same for the two 
yardsticks of economic status.° 

Let us now look at a third example from the McFadden sur- 
vey. In this study no intuitive ratings were used, but two other 
three-step indices of economic status can be developed : one from 
the reduction of home-ownership and car-ownership, as men- 
tioned in the first table in this paper; as a second index we 
use just the age of the car. Respondents are divided into those 
whose car is less than two years old (high economic status), 
those whose car is two or more years old (middle economic 
status), and those who do not own a car at all (low economic 
status). 

As a third variable we chose this time the proportion of 
families in each group who had no magazines at home when the 
survey was made. The McFadden survey laid much stress upon 
discovering non-magazine families. The following table shows 
that here again the influence of economic status upon magazine 
reading, as measured by the increase in the proportion of non- 
magazine families with decreasing economic status, comes out 
practically the same whichever of the two indices is used. 

We have given here three examples taken from studies which 
cover a large number of respondents and which were made with- 
out thought of the problem discussed here. Quite different 
three-step indices were used to measure the influence of eco- 
nomic status upon what might be called psychological or cul- 

® We do not discuss here the fact thai the respondents probably exag- 
gerate their interest in classical music. The figures are much higher than 


anyone who has experience with actual listening figures has ever found 
them. But that does not bear upon the topic of this paper. 
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Per cent of non-magazine families 
Status Status measured by Status measured by 
automobile age index car—home index 
ae 113 8.9 
TT sincdieninotecrentie 22.4 175 
UI scsinanchicsinnsbats 35.4 33.6 





tural phenomena, and as far as those indices could be compared 


in pairs they proved interchangeable for the measurement of 
‘economic influence.’’ 


QUALIFICATIONS OF THE PROBLEM 


Of course, these few examples do not settle the question, but 
they serve to attract attention to a theoretically interesting 
possibility with wide practical implications. Many tests must 
be made to find out when the interchangeability of indices is 
possible and when not. Studies in the files of research agencies 
could be scrutinized for significant material. Especially valu- 
able would be studies in which a great number of indices have 
been used at the same time, so that more than two indices could 
be compared simultaneously. Light could then be thrown, per- 
haps, on questions such as the following: Which economic char- 
acteristics (in the sense defined above) can be used for the con- 
struction of interchangeable three-step indices? In our ex- 
amples, home, car, and telephone ownership and paying of an 
income tax were used: But how about ownership of refrig- 
erators or even of pianos? Can any two economic character- 
istics be combined to form a three-step index, or do some com- 
binations lead to difficulties? Which psychological and cul- 
tural variables are adaptable to this way of measuring economic 
influence? The examples in this paper included a political at- 
titude, a radio program preference, and magazine reading: 
Would the same indices be interchangeable in the measurement 
of economic influence upon the amount of listening, other pro- 
gram preferences, or brand preferences in different fields of 
consumption? Finally, how far could this whole idea be ex- 
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tended to include indices of more than three steps? Only a 
wide range of material carefully analyzed can answer these 
questions, and for this the cooperation of many research agen- 
cies in many fields of business and social research will be needed. 

On one special point a further analysis of the above material 
is fruitful. It seems probable from theoretical considerations, 
as well as from empirical evidence, that for two such three-step 
indices to be interchangeable they must break down a sample 
into two similar distributions. In the first example, taken from 
the survey of the American Institute of Public Opinion, the 
‘*frequencies’’ of the three economic status groups were rather 
similar for both indices, as the data of the following table show. 











Number of cases in each group 
Status 
Intuitive rating Car—telephone index 
TE lie teinectonce “ 1380 1101 
Middle 510 865 
SE ibiitiieene 798 722 
a 2688 2688 





The frequencies of the car-telephone index are enforced by 
the procedure of reduction from which the index is gained. 
The combination of the five original steps in the intuitive rating 
scale into three steps is arbitrary. We could have combined the 
original classes differently, and then the frequencies as well as 
the proportion of Landon voters would have been different. 
The following table gives those figures under the assumption 
that Av + would have been considered the high class, whereas 
the middle class would have been composed of Avand P+. (In 
our original example Av belonged to the high class.) 

The difference in the proportion of Landon voters between 
the high and the low status groups is smaller when the second 
mode of combination is used. That is to be expected; if the 
proportion of Landon voters decreases with status, then the 
proportion in the high group should be lower when we inelude 
more people, by definition, in this group. 
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Frequencies Frequencies 
where com- where com- 
Per cent Per cent 
Status bination is of Landon bination is of Landon 
(Av+) voters (Av+t, Av) voters 
(Avy, P +) (P +) 
| (P, OR) (P, OR) 
ee 375 53.2 1380 42.5 
Middle ........... 1515 28.3 510 21.7 
oa = 798 15.9 798 15.9 
Total ........ 2688 2688 





It seems, then, that in our first example the two indices were 
interchangeable because we were roughly able to equate the 
frequency distribution of the intuitive rating with the fre- 
quency distribution of the combination of economic character- 
istics. But it is not in the hands of the student to change a 
frequency distribution which originates from the reduction of 
a four-fold table into a three-step scale (as described on page 
37) for there is only one way of combination. With intuitive 
ratings of more than three steps, however, the possibility of 
combining the data in several ways offers a flexibility which 
makes possible an equating of the frequencies. 

In the Fortune survey it so happens that the intuitive rating 
scale gives much smaller frequencies in the high and low status 
groups than those resulting from the home—income tax index. 
Thus, whatever psychological variable is investigated, the dif- 
ference between the high and the low economic level is always 
smaller if measured by the home-income tax index than if 
measured by the intuitive rating. Because of the importance 
of this aspect of the problem and because it furnishes further 
illustrative material for the main thesis, the actual figures are 
given in the Appendix. 

The thesis of the interchangeability of indices of socio-eco- 
nomic status for the measurement of economic influences upon 
psychological variables will need careful theoretical analysis, 
onee further empirical research proves its validity. A discus- 
sion of this problem in terms of the theory of correlation must 
be reserved for another occasion. 
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APPENDIX 


As was mentioned in the text, the two indices compared in 
the Fortune study had a rather different distribution. The 
following table gives the number of cases falling into the three 
classes. 





High Middle Low Total 


Intuitive Rating 10.1% 70.3% 19.6% 100.0% 
Home-Income Tax Rating 20.6% 44.1% 35.3% 100.0% 











It was impossible to get a more comparable distribution. Ac- 
cording to the analysis developed in the text, we should expect 
the first index to be more sensitive because, since the extreme 
groups are smaller, the respondents included in those two 
groups should cater more to the extreme points of view. This 
is corroborated by the following list of questions, the answers to 
which are broken down according to economic status as mea- 
sured by the two yardsticks. 

‘*Which leisure-time activity do you like the least?’’ 

The per cent of people mentioning radio: 











Economic status measured by 

Intuitive rating Home-income tax index 
pt ee 5.7 5.1 
ne 3.5 3.1 
ae a 2.6 2.8 





‘*Would you favor a third term for President Roosevelt ?’’ 











Per cent of people favoring it: 
Economic status measured by 
Intuitive rating Home-income tax index 
SN eedictleyieimsnainionie 41.0 48.0 
MAGN G oo ccecseereeoen 61.0 63.9 


OP isc hice 69.5 68.2 
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‘*If the presidential election were held now, would you think 
the vote for Roosevelt would be smaller ?’’ 
Per cent of people expecting a smaller Roosevelt vote: 











Economic status measured by 
Intuitive rating Home-income tax index 
SUN aitlcentctnincttbas 58.7 52.2 
Middle ............. 51.3 37.5 
SO esisinsicin baht 29.9 31.0 





A similar difference was shown above regarding the prefer- 
ence for classical music. 

It might be worthwhile to stress that there is no ‘‘ best index.’’ 
An index can be misleading either because it does not corre- 
spond to the average appraisal which reasonable people would 
make of the other fellow’s economic status; or because it con- 
tradicts results which we have obtained with another index in 
which we have greater faith for some practical reasons. That 
an index is more sensitive in the sense just used, does not mean 
that it is necessarily a better one. Many discussions are mis- 
carried because the logical problems involved here are misunder- 
stood. They have no bearing, however, on the point which this 
paper makes. 


The author is greatly indebted to Mr. J. P. Dean for help 
in the preparation of this paper. 
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Section II. Program Research 


Editorial: It seems that program testing is the part of radio 
research which first caught the attention of psychologists. Most 
of the papers sent in answer to our request for contributions, 
pertained to this section. The content of the articles, together 
with the discussion in the introduction to this volume, should 
give the broadcaster as well as the psychologist a fairly good 
idea of the present trend in program testing. A more detailed 
analysis is referred to in the last footnote to the third paper. 


A METHOD FOR DETERMINING THE ENTER- 
TAINMENT VALUE OF RADIO 
PROGRAMS 


H. P. LONGSTAFF 
University of Minnesota 


URING the fall of 1937 the writer was called in by a 
manufacturing concern to investigate the entertain- 
ment value of one of the several radio programs the 

concern was sponsoring. This article will be confined to a 
description of the methodology used in the study. 

The writer makes no claim to the originality of any of the 
specific techniques used in the investigation. Any merit this 
paper may have will lie in illustrating how standard psycho- 
logical and statistical methods can be combined to give a rather 
clear-cut evaluation of certain types of radio programs, and in 
this way be of value in guiding other workers in the field of 
radio program evaluation. 

The program investigated was a novelty one consisting of 
music, interviews with celebrities, short dramatic sketches, and 
the like. It was a fifteen-minute daytime program broadcast 

46 
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five times a week on a coast-to-coast network. The program 
had been on the air for about two months when the investiga- 
tion was undertaken. 

The sponsoring company wished to discover the following 
things about the program: 

1. How does it compare in entertainment value with other 
daytime programs? 

2. Do listeners like it more or less the longer they listen to 
it? In other words, what is the “‘wearing’’ quality of the 
program ? 

3. What features were liked best and least ? 

4. What could be done to improve the program? 

These are questions that might well be asked regarding any 
radio program, and any method which enables one to answer 
them should be of value. 

The listeners who furnished the data to answer the above 
questions were a group of housewives selected by interviewers 
from ‘‘B’’ and ‘‘C’’ homes and paid one dollar a week to listen 
to and report on the programs. This is the ‘‘ paid-jury’’ tech- 
nique now in use rather widely. Throughout the study every 
effort was made to assure the subjects that it was their un- 
biased opinions that were wanted. There was considerable 
evidence that the subjects were not unduly influenced in a 
favorable way toward the company or program by the remu- 
neration they received since many of the comments were 
scathing in nature. 

The criticisms of paid-consumer juries have been pointed 
out by Link.’ If the investigator is aware of the dangers in 
the method, most of them can be overcome by the use of the 
personal-interview technique. An especially important advan- 
tage in favor of this method is that of having a representative 
sample of interested and cooperative subjects. This seems to 
the writer to more than compensate for its possible short- 
comings. 

After careful pre-testing, the three questionnaires repro- 
duced below were decided upon as the measuring instruments. 
1H. C. Link, The New Psychology oj Advertising and Selling, 1932. 
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The name of the program, the broadcasting station, and the 
time of broadcasting are fictitious. 
FORM A, Date PROGRAM XYZ 


Monday, Tuesday, Wednesday, Thursday and Friday 
Over Station PQR 8: 30 a.m. 


ae pee Se ee ee ee Meee 
value of the program, ‘‘XYZ.’’ In answering the questions below please 
keep the following points in mind. 


1. Read each question carefully and give us your honest opinion 
about the ENTERTAINMENT value of this program. m’t 
say it is good unless you really think it is. We want very much 
to know how it affects YOU, good or bad. 

2. There are several statements in each question, read all the state- 
ments and check the ONE which most nearly agrees with the way 
YOU FEEL about the program. 


* * + * * * * * * . 
Ques. 1—In this first question compare this program, ‘‘XYZ,’’ with 


other DAYTIME programs you have heard and check the ONE 
of the five statements which best tells what you think of this 





program. 

Bi cencintl . I think the program is uninteresting and not up to most day- 
time radio programs. 

Di ectereaias . I enjoyed the program very much. I think it one of the best 
daytime programs I have heard, and I am looking forward to 
hearing it again. 

i patent .. The program is one of the worst daytime programs I ever 
listened to. 

i cininemite . I think the program is about an average daytime program. 
There are many others as good or better. 

Di rcitnt .. L enjoyed the program more than I do most daytime radio pro- 


Ques. 2—Now we would like to have you think about TODAY’S pro- 
gram ‘‘XYZ’’ and tell us in your own words what YOU: 


A. Liked most (Write here what you liked most) 
B. Liked least (Write here what you liked least) 


C. Write here anything or anyone in today’s program you would like to 
have heard more about. 




















Write here any further remarks or comments you have about the pro- 
gram. We will appreciate ANYTHING you have to tell us... 


Int. Initials ................ 
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FORM B, Date 
Program XYZ 
Monday, Tuesday, Wednesday, Thursday, Friday 
Over Station PQR 8: 30 a.m. 


It is very important that you tell us how YOU FEEL about each day’s 
program. DO NOT TRY TO PLEASE US. Just tell us in your own 
words whether or not the program left you feeling pleased, bored, dis- 
gusted, ete. If you liked today’s program, PLEASE say so, but if you 
did NOT like it, PLEASE say so. We depend wholly upon your OWN 
PERSONAL opinions. Therefore YOU CANNOT BE TOO FRANK 
IN YOUR ANSWERS. 











Ques. 1. Tell us in your own words what you: 
A. Liked most in today’s program 
B. Liked least 











C. Write here: would you have liked to have heard more about 
anyone or anything in today’s program ie 


Ques. 2. Now we would like to know whether you think today’s pro- 
gram was better or worse than other XYZ programs you have 
heard. Check one of the following five statements. 

Ba sient Today's program was VERY, very much better than 
other days. 

>. aeiininnd Today’s program was VERY, very much worse than 
other days. 

enlaniaione Today ’s program was about the same as on other days. 

cnuthisabiouts Today ’s program was better than most other days. 

a Today’s program was not as good as most other days. 


Write here your reasons for the answer you checked above. What made 
the program better, worse, or the same as other days? 








HS 








If you have any further remarks or comments about today ’s program 
write them here: 











_  - ee i 
REMEMBER! YOU CANNOT BE TOO FRANK IN YOUR 
ANSWERS 





FORM C, Date 





PROGRAM XYZ 
Monday, Tuesday, Wednesday, Thursday, Friday 
Over Station PQR 8:30 a.m. 


You have been listening to this om for several days now and 
know something of what it is like. , we should like to have you again 
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a 





eT Ga es: 


wh rine sheen rae 





ONE ts PRE Te 


_—— 








50 H. P. LONGSTAFF 


compare this program, ‘‘XYZ,’’ with other DAYTIME programs you 
have heard and check the ONE of the five statements which best tells 
what you think of this Pe com 
i doce I think Pedra. enOenneting and, net, wy to mest 
daytime programs. 
D, «nue I enjoyed the program very much, I think it one of the 
peel ng nam eontne ft an —"" heard, and I am looking for- 
to t 
Cy nee The program is one of the worst daytime programs I ever 
listened to 


Ge vnccosmmm I think the program is about an average daytime program. 
There are many others as good or better. 

Di sists I enjoyed the program more than I do most daytime radio 
programs but I think there are some that are better. 


Ques. 2—This is the same question you answered y but remember 
it is today’s program we are interested Tell us in your own 
words what you: 

A. Liked most in today’s program 


B. Liked least 


C. Write here anything or anyone in today’s program you would 
like to have heard more about 


Ques. 3—Now we would like to know whether you think today’s program 
was better or worse than other XYZ programs you have heard. 
Check one of the following five statements. 
























Ay cco Today ’s program was about the same as on other days. 

By coe Today ’s program was better than most other days. 

CY nennocsee Today ’s program was not as good as most other days. 

Bigs aoe ’*s program was VERY, very much better than other 
ys. 

lly atkins y — ’*s program was VERY, very much worse than other 


ys. 

Write here your reasons for the answer you checked above. 

ee ee eee & CAEN oe otter 
ys 








Write here any further remarks or comments, good or bad, 


‘ou have about the program. We will appreciate ANY- 
THING you have to tell us. 








Form A was used only once, the first day of the investiga- 
tion. Form B was used daily except Friday, when Form C 
was used. The five steps in the attitude scale were rotated to 
overcome the danger of the subjects’ forming a position habit 
in making their ratings. 
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Personal interviewers called upon the subjects each day, col- 
lecting the questionnaires the subjects had filled out that day 
and leaving the next day’s questionnaire. The interviewer ex- 
amined each questionnaire before she left the subject and fol- 
lowed up any leads that were indicated and straightened out 
any points that were not clear. In this way complete data 
were assured on each questionnaire. One hundred seventeen 
women took part in the investigation, which extended over a 
period of five weeks. The average number of subjects listening 
each day was 112.5, which is one indication of the high degree 
of cooperation received when the paid-jury method is used. 
Of course, there is the possibility that the ‘‘mortality’’ rate 
may vary with the amount of remuneration paid and the 
amount of time the subject has to devote to the research. 
However, the writer feels that from his experience in this 
study and from his knowledge of a considerable amount of un- 
published data a margin of fifteen per cent more subjects than 
the size of sample desired will be found adequate in paid-jury 
studies. Only once during this investigation did the sample 
drop below 102 subjects. That was on Thanksgiving day when 
97 subjects listened to the program. 

The data were treated as follows: Each step on the five-step 
opinion scale was weighted from 1 to 5 (worst to best). An 
average rating was computed for each day’s program by mul- 
tiplying each step in the scale by the number of subjects giv- 
ing each rating, summating these products and dividing by the 
total number of subjects. Similar averages were computed 
for the ratings made on Friday where the XYZ program was 
compared with other daytime programs. This procedure as- 
sumes the differences between the steps of the scale to be equal. 
This assumption may be criticized on a theoretical basis. But 
it seemed justified in this practical situation in that it provided 
a rough index of the popularity of each day’s program. 

As a result then, we have three kinds of data. 

(a) Average ratings for the programs based on the five-point 
seale just discussed. These ratings are either daily ratings 
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comparing each program with the program heard on the pre- 
ceding days of the test period; or they are weekly ratings 
comparing the total series under investigation with other pro- 
gram series of the same kind. As an example the following 
daily ratings for the programs of one week might be quoted. 








Monday 2.9 
TUCSAAY nnccecccccccensensnee BoB 
Wedmesd ay -..ccccccccnn 3.2 
SS | 
Friday 2.8 





These ratings describe, so to say, the wearing quality of the 
program. If the program wears well or grows favorably upon 
the subject, the trend of these figures should either approxi- 
mate a level line or slope upward. If the program does not 
wear well, then the smooth trend should slope downward. 

(b) In addition to plotting the daily average rating, histo- 
grams were prepared for each weekly or daily rating sepa- 
rately. The value of this group of data lies in the clear man- 
ner in which they present a difference of opinion. As an 
example we quote the distribution of the five-step rating scale 
for the Tuesday and Wednesday included in the preceding 
table. The average ratings for those two days. are practically 
the same. But the distribution of opinion is quite different. 








Rating Tuesday Wednesday 
1 30% 10% 
2 5% 20% 
3 5% 20% 
4 40% 30% 
5 20% 20% 
100% 100% 





Whereas the Wednesday program shows a unimodal distribu- 
tion, the Tuesday program shows two rather sharply defined 
peaks. It can be assumed that there was on Wednesday one 
prevailing opinion to which all the women subscribed, whereas 
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on Tuesday two different attitudes were operative. When 
the comments were studied it was discovered that the older 
women thought this day’s program vulgar and rated it low, 
while the younger housewives thought it very sophisticated 
and amusing and rated it high. One might conclude from this 
that programs that are too sophisticated may antagonize a 
fairly large per cent of older women and should be avoided. 

(ec) The third group of data was based on the free com- 
ments which the respondents were invited to make. 

All the comments, of which there were many, were classified 
and appended to each report. The number and nature of the 
comments were studied. These remarks proved a valuable 
source of information for shaping the content of future pro- 
grams, as well as for evaluating the different features that 
went to make up each day’s program. 

Several features were tried out in the hope of improving 
the entertainment value of the program. The comments con- 
cerning these features were plotted in two ways, according to 
the number of comments made and according to the nature of 
them, whether they were favorable, unfavorable, or neutral. 

The nature of the features in the actual research was such 
that they cannot be fully discussed here without disclosing the 
name of the program investigated. However, the following 
sample comments may help to illustrate the way in which they 
were used. ‘‘I suppose all we will hear for the next three 
weeks is the new feature.’’ ‘‘They are just making a big issue 
out of something which will probably amount to nothing but 
disillusionment of the person involved.’’ ‘‘The way the fea- 
ture is handled sounds rather fishy.’’ ‘‘Dislike the insincer- 
ity.”’ ‘‘Liked least Mr. X—sounded like a phoney.’’ The 
feature being tried out was actually strictly above-board but 
the fact that it did not ‘‘ring true”’ as is indicated by the above 
comments shows it was being badly handled and that imme- 
diate steps must be taken to overcome this attitude. At the 
same time such favorable comments as ‘‘A real fairy tale of a 
lovely person who deserves recognition,’’ ‘‘I admire Y’s cour- 
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age,’’ ‘‘Like Y’s wholesome enthusiasm,’’ provide suggestions 
for increasing the feature’s popularity. Not only was the total 
number of subjects making favorable, unfavorable, and no 
comments recorded, but the frequency with which each com- 
ment occurred was also determined. This provided informa- 
tion as to the prevalence of any particular idea; for example, 
12 subjects made comments that were classified under the 
heading, ‘‘ Lack of sincerity, feature doesn’t ‘ring true.’’’ In 
this way it was not only possible to discover the nature of the 
subject’s reaction but also the extent to which any particular 
comment existed. In general, the more frequently a given 
comment is made the greater the importance one should attach 
to it. Recordings were made of each day’s program. These 
were studied in the light of the comments as a further check 
on the program. 

In conclusion, it was felt that the method afforded a reason- 
ably factual analysis of the program in that it made possible a 
clear-cut presentation of results in a form that was easily un- 
derstood by statistically untrained individuals and at the same 
time permitted the application of highly refined statistical 
procedures if desired. 


DETERMINING THE APPEAL OF SPECIAL 
FEATURES OF A RADIO PROGRAM 


F. BR. COUTANT 
Marketing Counsel, New York 


ce only information available so far from which to 
gauge the reception of a radio program is the so-called 
‘‘ratings.’’ A number of commercial agencies have an 
organized field staff by means of which they telephone people 
to ask them either what programs they are listening to at that 
moment, or what programs they have heard during the hours 
immediately preceding the call. 

Even supposing that we can identify the liking of a program 
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with the size of its audience, the problem of what is liked about 
the program still remains. Special research is needed to an- 
alyze the single features of a program if improvements in pro- 
gram-building are to be put on a systematic basis. This com- 
munication purports to present one helpful experince in an- 
alyzing the successful and unsuccessful features of a radio 
program. 

People in various cities were invited to parties by repre- 
sentatives of the company interested in the program, and the 
programs were presented to them on a playback machine. 

These playback machines were a problem, because acetate 
radio recordings are made to play at 33 R.P.M., and ordinary 
phonographs play at 78 R.P.M. Besides, radio records play 
from the inside groove out, and phonograph records vice versa. 
Amplification of sound through radio tubes is involved. The 
playback machines must be portable, because the test-audiences 
usually are not. There do not seem to be any suitable portable 
machines on the market, but it was found easy to get a tech- 
nician to build them for $80 each. 


The following questionnaire is typical, though the names and 
dates used are fictitious : 


PROGRAM HEARD OVER STATION WWTR 
Wednesday, December 7, 1938, 9 to 9: 30 P.m. 








Cheek here your age classification Under 25 yrs 35 to 40 
2 to 30 X 40t0o45 
30 to 35 —is«er 45 

What is your opinion of: Uninter- reir Gooa Exel 

esting lent 

1, Announcer’s Voice x 

2. Announcer’s Personality ...................... x 

3. Ammouncer’s Message ...cccccccccvernnme 

4, Mary Marlin’s Voice .....cccccccceccnonn x 

5. Mary Marlin’s Somg ....ccccccccccoooccnnon x 

6. Orchestra Quality x 

7. Orchestra Choice of Music ................. 


Dramatic Sketch 
Feminine Lead x 
Leading Man x 


ad 
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10. Story x 

11. Climax x 

12. Guest Star—Rudy Rudich—Voice .. x 
13. Personality ccccccocen rs x 
14, RR 

15. Empire State Chorus Voices ............ x 

16. Empire State Chorus Songs ............... x 


To get a handy index for the appeal of each feature the fol- 
lowing values were used: 5 for uninteresting, 10 for fair, 15 
for good, 20 for excellent. The following table gives the way 
a net rating of a single feature would be computed from the 
judgment of 100 people. 























Rating People Points Total 
Uninteresting 14 x 5 70 
Fair a ae 220 
Good Ss 2:8 480 
Excellent S. a 640 

Divide by number of interviews .. 100) 1410 








The final result is a list of the single-feature ratings which 
permits a comparison of the relative merits of the different 
features of the program. The following table gives the ‘‘appeal 
profile’ for a specific program : 

















Feature Rating Feature Rating 
Ann—Voice 15 Leading Maan .................... - & 
Ann—Personality ............ 22 Story 10 
AMM— Message onnccccccscrerrvnneen 11 =s- Climax 8 
Mary Marlin—Voice ........ 30 Rudy Rudich—Voice .......... 26 
Mary Marlin—Song ............. . 20 Budy Rudich—Personality.. 24 
Orchestra—Quality ................ . 85  #Budy Rudich—Material .... 9 
Orchestra—Musie Choice ... 32 Empire State Voices ............ . 20 
Feminine Lead .................... 27 Empire State Songs ~ 





For commercial clients the results would have to be given in 
the form of a graph. The experienced reader can easily vis- 
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ualize the feature-profile which could be drafted from the fig- 
ures just reported. The result of this special evaluation is 
quite evident: The program seems to carry excellent talent, 
performing with mediocre material. The high points are the 
voices of two performers and the quality of the orchestra. 
The lowest point is reached wherever the question pertains to 
story, message, material, and other features of the content. 
The practical applications are obvious. The sponsor will try 
to provide different material for the same performers, and thus 
improve the chances of his program before going to all the 
expense of putting it on the air. 

It is not very easy to set up a good list of features to be 
tested by such a procedure. If the list overlooks features of 
importance, then the results might be misleading because we 
get ratings only for those features included in the list. There- 
fore it is generally advisable to have such an evaluation pre- 
ceded by a more informal experiment. It proved very helpful 
first to play the program to groups of people who might be 
gathered in a elub-meeting or some other pastime. By observ- 
ing this sort of test-audience to note when they became restless 
or when they showed particular signs of interest, the trained 
observer could get the necessary leads to,;draw up a complete 
list of all those features which might be positively or nega- 
tively relevant to the success of the program. 


A DIFFICULTY IN THE FEATURE-ANALYSIS 
OF A RADIO PROGRAM 


ELIAS SMITH 
Princeton Radio Research Project 


NYONE who tries to evaluate different features of a radio 
program soon meets a certain difficulty, known to psy- 
chologists as the ‘‘halo effect.’’ If people like or dislike 

a program as a whole, they seem inclined to transfer this general 
impression to the single features about which they are asked ; or 
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they are not able to point to a special feature as accounting for 
their reaction. 

Certain distinctions are necessary. If, for instance, a pro- 
gram is obviously divided into different parts, the test-audience 
seems able to judge each part separately. A comedian could be 
liked while the orchestra which played after he told his story 
might be judged to be bad. It is not at all certain that people 
are able to distinguish clearly between the plot and the acting 
of a radio drama. Coutant, in the paper included in this issue, 
reports a case where the actors in a variety show are liked, but 
the material they present is disliked. In other cases it is re- 
ported that the acting can really make or break a show. Still 
more subtle distinctions can safely be considered too difficult for 
the average listener to make. In Coutant’s example the voice 
and personality of the actor are always rated the same and, 
indeed, these two features are probably too closely linked to be 
separated by the introspection of an untrained person. 

This point is crucial for the future of program research, and 
further investigation will be necessary to clear it up. Only by 
conducting actual program tests shall we be able to know finally 
which features can be evaluated for themselves and which are 
too closely linked either to the program as a whole, or to one 
another. 

The purpose of this communication is to give two examples 
which bring this difficulty clearly to the foreground. The first 
distinction is drawn from interviews with 185 persons in New 
York City who had voted either for Dewey or for Lehman in the 
recent gubernatorial campaign. They were asked: ‘‘ Which 
man do you think is the better radio speaker, Dewey or Leh- 
man?’’ Their answers, tabulated against their actual votes, 
gave the following results : 

Preferred radio voice of those who voted for Dewey: 
81% Dewey 4% Lehman 15% About the Same 
Preferred radio voice of those who voted for Lehman: 
28% Dewey 42% Lehman 30% About the Same 


Obviously, general approval of the candidate influenced the 
evaluation of his radio voice. 
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The second example is taken from a study not concerned with 
radio. A number of interviewers on a certain study were asked 
to appraise how 200 women were dressed. The question read: 
‘Would you rate the respondent as dressed in very good taste, 
fair taste, or poor taste?’’ In the same study it was necessary 
to get a rough idea of the respondent’s size because of the bear- 
ing of this factor upon the merchandise for which the study was 
done. Therefore another question was asked: ‘‘Is the woman 
light or heavy?’’ This rough information seemed satisfactory 
for the purpose of this particular study. 

It occurred to us to tabulate the answers to the two questions 
simultaneously, and the following table was the result : 














Fashion ratin 
Stature of interviewed ad 
women Good Fair Poor Total 
taste taste taste 
Light 43.0 50.0 7.0 100.0 
Heavy 15.0 70.0 15.0 100.0 








On the basis of this table it is quite evident that the inter- 
viewer’s impression of a woman’s taste in dress was influenced 
by her stature. The heavier women were more likely to be con- 
sidered less ‘‘elegant.’’ 

The difficulty of singling out special features as decisive for 
like or dislike has been found in other studies mainly in the 
field of experimental product improvement. Ripin ana Lazars- 
feld had women choose between two fabrics and explain what 
made the one preferable. Women would often point to combi- 
nations of features and an interpretation would show that they 
liked for instance one weight for smooth fabrics and another 
weight for rough ones. D. Katz has reported a very inter- 
esting series of studies in which he observed bakers judging 
whether a certain dough was ready to be put in the oven. He 
found that the bakers were very consistent in their judgments, 


1‘*The Tactile-Kinaesthetic Perception of Fabrics with Emphasis on 
Their Relative Pleasantness,’’? JOURNAL OF APPLIED PsycHOLoey, 21, 
1937, 208-216. 
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but it took a great deal of systematic observation of their pro- 
cedure by a psychologist before it was possible to point to those 
features of the dough which determined the baker’s judgment.? 

It seemed worthwhile to point to such research experience in 
other fields at a moment in which the feature analysis of radio 
programs has begun to receive much attention.* 


THE SEPARATION OF APPEAL AND BRAND- 
NAME IN TESTING SPOT ADVERTISING 


C. E. OSGOOD, C. N. ALLEN, anp H. 8. ODBERT 
Dartmouth College 


THE PROBLEM 


IS is a laboratory study of a method to test variables 
independently that are ordinarily thought of as being 
inseparable. It is usual to test advertising copy by 

various rule-of-thumb methods, all more or less closely related 
to sales, devised by Link and others interested in measuring 
the effectiveness of advertising. Such methods cannot test, 
and particularly pre-test, the relative importance of such major 
variables as appeals and brand-names. 

Psychological laboratory studies of advertising have been 
criticized as being inconclusive because of their remoteness 
from the buying situation. Our college-student subjects are 
admittedly over-critical of advertising and generally inatten- 
tive to much of it and are not typical buyers. Another objec- 
tion frequently made is that general appeals cannot be ab- 
stracted from other factors in advertisements. "We propose to 
demonstrate a method whereby independent variables can be 
isolated and measured. We have created an experiment to 
test radio spot advertisements for ten products with fictitious 


2D. Katz, ‘‘The Judgments of Test Bakers,’’ Occupational Psychol- 
ogy, 12, 1938, 139. 

8 A more detailed analysis of ‘‘ psychological problems in program test- 
ing’’ by Lazarsfeld and Stanton will be published in the Psychological 
Record. 
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brand-names by ten appeals and by ten methods of presenta- 
tion. The general procedure is found in an adaptation, at a 
more complex level, of McCall’s rotation method. This method 
allows us to control variables in an arbitrary manner and to 
force copy into a rigid formula. 

Rule-of-thumb methods assume that their samples are large 
and typical enough to allow extraneous variables to cancel out. 
We have made our variables cancel out by balancing, as seen 
in Table I. 


Appeals? are indicated by numbers, as follows: 


1, economy 6. universality 

2. prestige 7. efficiency 

3. sex 8. beauty 

4. health 9. comfort 

5 self-esteem 10. safety 

Methods of Presentation® are indicated by letters: 

a. straight voice #1 b. straight voice #1 
a. straight voice #2 b. straight voice #2 
¢. strange voice f. strange voice 
d. sound effects g. sound effects 
e. two alternating voices h. two alternating voices 


THE PROCEDURE 


There are ten 12-inch records, recorded on acetate, each side 
running about six minutes. Record I, for example, contains 

1W. A. McCall, How to Experiment in Education, 1923, 31-36; 187- 
207. 

2 Each appeal is defined in the copy for each record and is maintained 
according to formula in every case. See sample record X. 

8 Methods a, c, d, and ¢ employ the revealed form of announcing the 
product name, while methods b, f, g, and h employ the delayed revealed 
form of announcement. (See L. W. Doob, Propaganda, 1935.) The 
reason for two methods keyed a and b is that originally the first straight 
voice was to be masculine and the second feminine. This complicating 
factor was eliminated but balance was kept by retaining two forms of 
the same straight voice. It was recognized that the ten methods were 
not fully balanced. The gain in naturalness partially offset the lack of 
complete balance. A check on the relative effectiveness of methods 
appears in the appendix. 
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the ten spot announcements keyed in Table I as la, 2h, 3d, 
4b, and 5 c on one side and 6 b, 7 e, 8 f, 9a, and 10 g on the other 
side. The products are those generally used by college stu- 
dents. Each record of ten announcements is presented to a 
different group and is a cross-check of the three major variables 
of product, method, and appeal. The brand-name is repeated 
twice in every case; position in the series is regulated in rota- 
tion to control the recency factor ;* and each announcement 
is approximately the same length. Each appeal appears only 
once with each product and with each method. This makes 
some announcements seem far-fetched, but perhaps no more 
than some commercial announcements. Finally, each of the 
ten appeals appears once with each product, once with each 
method, and once in each position in the series of ten. 

The following sample record illustrates the nature of the 
copy. 

RECORD X 

1. 10¢: Two alternating voices; revealed. Safety appeal. 


#1. The makers of Johnson’s aspirin are ever aware of the need 
for safety. Our aspirin is made and marketed with this 
constantly in mind. 

#2. I suppose you have in mind the fact that many patent medi- 
cines are said to be dangerous to the heart. I know of 
one instance in which a fatal stroke followed the use of 
a cheap substitute for a standard brand of medicine. 

#1. There are many such true stories. It will pay you to use 
aspirin you know is safe. 

#2. I'll relieve my headaches safely; I’ll use only Johnson’s 
aspirin. 


2. 1f: Strange voice; delayed revealed. Economy appeal. 


It’s a real buy for your money—in a new large-sized pack. You 
now get seven sticks of gum for the same price you formerly 
paid for five. This means a substantial saving in the long run. 
It has a swell flavor and the flavor lasts. What is it? Why 
you know—Lucky Gum. Think! For much less than a penny 
a stick, you get the purest, tastiest gum money can buy. With- 

« As a further control of recency, two dance records were played after 
the test record was finished. 
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out lowering their well-known standards of quality, the makers 
of Lucky Gum offer you this saving. 


3. 2a: Straight voices; revealed. Prestige appeal. 

#1. As you undoubtedly know, Viking is the shoe picked by 
those who want the best. Its manufacturers have created 
beauty and style without sacrificing durability or com- 
fort. This shoe is a favorite with those whose apparel 
must be perfect. But you need not take my word for it. 
Paul Naylor, the famous film star, says: 

#2. Every detail in an actor’s attire is scrutinized by directors, 
critics, and fans. My shoes must be up to the minute in 
style and yet guarantee foot-comfort. Only Viking shoes 
meet these requirements.5 


4. 3g: Straight voices with sound effects ; delayed revealed. Sex appeal. 
#1. Here’s the story of a wise young man. He made sure his 
tie was straight and his hat cocked to just the right 
degree, and then started out on a date with his lady fair. 
The evening was lovely. The orchestra was smooth. 
Dancing was perfection. The wise young man and his 
lady fair wandered out upon the terrace. But there, 
despite the twinkling stars and mellow moon, an argu- 
ment started. There came a sudden unwieldy pause. 
(Long pause.) 

#2. (Speaking at a distance from the microphone.) Won’t you 
have a cigarette, my dear........ a Mellow? (Short 
pause.) Anda light? (Sound of match lighted, inhal- 
ing and exhaling smoke.)5 

#1. Soon they were happy lovers once more. Relieve that un- 
easy pause; cool off with a Mellow! 


5. 4a: Straight voice; revealed. Health appeal. 


See that girl in the Crawford Swim Suit? She’s a healthy girl, 
isn’t she? See the glow of color on her cheeks. See the sparkle 
in her eyes. Note how clear and fresh is the color of her skin 
and how light and buoyant is her step. She’s also a wise girl. 
She knows she must keep her health by eating nourishing food 
and getting plenty of outdoor exercise. And on the beach she 
wears a swim suit that gives her the ultimate in swimming com- 

5 The second voice in the third and fourth advertisements is for dramatic 
effect. In the method defined ‘‘Two alternating voices,’’ the two voices 
are of equal importance. 





TESTING SPOT ADVERTISING 65 


fort, as well as lending charm to her figure. She knows a swim 
suit must be cut right to give her true freedom in the water. 
That’s why she wears a Crawford Swim Suit. 


6. 5h: Two alternating voices; delayed revealed. Self-esteem appeal. 
#1. Are you going to join the throngs heading back to the old 
campus this year? If you are, have you checked up to 

make sure your teeth look right? 

#2. You’ll want them to come up to the standards of particular 
men and women. You’ll want them to be a sparkling, 
pearly white. 

#1. And you’ll also want to be sure your breath is fresh and 
clean. 

#2. We suggest you try Curtis Tooth Powder. It’s the den- 
trifice picked by those who value the health and beauty 
of their teeth. Curtis Tooth Powder makes your mouth 
feel right. 


7. 6d: Straight voice with sound effects; revealed. Universality appeal. 
You'll find Double X Camera Film in use all over the world. 
You’ll find it in countless American homes. If you ask, you’ll 
learn that many of your friends use it. If you listen, in your 
neighborhood drug-store, you’ll hear patrons requesting it. Its 
clean-cut photographic qualities are well-known to all. Just 
try it once and you’ll agree with all the other wise folks who 
are using it in their cameras. Just open up your camera. 
(Sound of camera being opened.) Slip in a roll of this popular 
film. (Sound of camera being loaded.) And you’re ready to 
take perfect pictures. Double X is the camera film approved 
by a million Americans! 


8. 7b: Straight voice; delayed revealed. Efficiency appeal. 

Efficiency is the key-note of the modern age. If products are 
to be sold, manufacturers must keep this fact ever in mind. 
Consumers want the products they buy to be up-to-date. Food 
products, especially, must be protected from spoilage by air- 
tight containers if they are to retain their purity and freshness. 
The next time you drop into the drug-store for a bar of candy, 
notice if the brand you buy has a double casing of protective 
cellophane. If it has, you’ve bought Douglas Chocolate, and 
that means you’ve bought the best. Keep in step with the 
modern age. Buy Douglas Chocolate Bars in their new, 
doubly-efficient containers. 
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9. 8c: Strange voice; revealed. Beauty appeal. 

The makers of the Finesse watch want to aid you in the search 
for beauty, which, I guess, is common to us all. From fifteen 
to fifty, all want to appear smart and attractive. So the young 
ladies may be seen studiously attending to the art of cosmetics 
and the young gentlemen spend long hours keeping fit in the 
gym. And how important it is that they wear a wrist-watch 
that conforms to modern ideas of attractiveness. A clumsy 
watch can completely ruin an otherwise perfect effect. A 
Finesse watch, a thing of beauty in itself, will complement 
your appearance. 


10. 9b: Straight voice; delayed revealed. Comfort appeal. 

May we draw for you a picture of almost perfect comfort? We 
see him stretched out in an easy chair, dressed in bathrobe and 
slippers. The day’s work is done, dinner is over, and his mind 
should be at rest. All set for a comfortable evening at home. 
But something is wrong. He frowns uncomfortably. He is 
annoyed at the constant irritation of an itchy sealp. No possi- 
bility for real comfort here. A frequent washing with a good 
shampoo would end his troubles. Gordon’s is a good shampoo. 
Keep your scalp clean and your hair lustrous with Gordon’s 
shampoo. 


The use of modern music as a background sustained atten- 
tion and reproduced fairly closely the usual conditions of radio 
broadcasting. The music started in full volume, faded out for 
each spot announcement, and then came in again for a mea- 
sured interval according to a fixed time schedule which was 
the same for all records. 

In the first two groups, classes in advertising, a preliminary 
oral statement was made to gain their interest and cooperation 
and to satisfy their curiosity to a limited extent. The other 
eight groups were given the same general instructions but with 
the difference that the instructions were played from a record 
to achieve uniformity and to accustom subjects to the condi- 
tions of the reproduction. The instructions were to relax and 
listen as they would to a radio program in their own homes. 
The well known ‘‘Chant of the Aucti ’? was included in 
the instruction record as an example of commercial announce- 
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ments and as a release for whatever tendency there might be 
to laugh or demonstrate in any way at the unusual. 

After a group was settled, the preliminary record was 
played and immediately followed by the test record for that 
group. The full ten announcements consumed about thirteen 
minutes. After about six minutes of the dance records the 
data sheets were distributed with the following instructions in 
print and supplemented orally : 

**You have just heard radio advertisements for ten products. Some 
people listen more attentively than do others, and some products register 


better than others. Will you record, below, your experiences using the 
standard blank provided.’’ 


Below this the ten products were listed in a new order and a 
place provided for writing in as many brand-names as could 
be recalled with this aid. After a five-minute interval, the test 
record was played again and a judgment obtained as to emo- 
tional reactions to each announcement. These data are not 
a major part of this report. 


THE RESULTS 


The first step was to record in a table similar to Table I the 
per cent of recall of each advertisement. (Percentages rather 
than raw figures were used to allow for the varying numbers 
in the test groups.) When these percentages were added for 
each record, it was seen that the average per cent of recall 
differed somewhat from one group to another, as follows: 


TABLE II 
Average Recall Per Record 





Records 





A: ee wee Ve OE VS Ck 





No. of Cases.......... 35 37 30 53 36 46 45 29 46 69 
Average % recall* 75 61 47 60 46 52 49 51 60 58 





* These differences appear to correspond closely to the differences in the 
attitudes and backgrounds of the test groups, and suggest that the records 
themselves were quite uniform in the effectiveness of their writing and 
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Because of this difference in average per cents of recall for 
each group, we have translated the actual percentages of recall 
into the amount of deviation of each advertisement above or 
below the average for the ten advertisements on a given record. 
These deviations are presented in Table III, in which each row 
represents a record and each column represents all advertise- 
ments having the same appeal, as economy. a 


TABLE III 
Deviation of Each Appeal from the Average of All Appeals on Each 
Record (Rotation Method) 


— JP, idndyd: 














1 2 5 6 7 8 9 10 
TL vnne O98 14 O1 09 09 -17 23 -23 -20 -.08 
TE enone 92 «611 «25 COS KCB =85 0B 0B 
THE nme 30 14 26 10 48 43 -07 -37 03 -40 
TV enn 39 «6623 11 «08S KAS -.05 «2-37 = 10 
Vi nnn 45 -15 -—35 -21 40 -04 02 34 -29 -.21 
VI enn 33 «60D BK A 200 «8722-200 BD 28 
VIE ennnnrre 25 30 36 -—16 -34 -18 29 18 18 .24 
VIL... 39 04 -41 32 -06 -—20 -23 32 -13 -.03 
TX ee 24 KA 02 17S 27-206 15-17) = 0507 
x 17 06 30 23 -26 17 -26 -22 -.28 .10 
Algebraic 
sums... 25 44 -05 .35 .71 31 -09 -37 -71 -41 
Ranks ...... 7 2 5 3 1 4 6 8 10 9 





When the deviations for all advertisements employing a single 
appeal are added, a final ranking of the effectiveness of the 


presentation. Records I and II were played to special classes in the psy- 
chology of advertising; the first was told it would be tested, and its score 
of 75 per cent reflects that fact. Records IV, IX, and X were played 
several months later, in a different room, and just before Thanksgiving 
recess. The averages for these three records compare well among them- 
selves: The range is 58 per cent to 60 per cent against a range for the 
other five, played to similar groups at a corresponding time and in the 
same room, of only 46 per cent to 52 per cent. 
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appeals is possible. As is shown in Table III, the rank order 
of these appeals, arranged according to strength, is as follows: 


1. self-esteem 6. efficiency 
2. prestige 7. economy 
3. health 8. beauty 
4. universality 9. safety 
5. sex 10. comfort 


There appears to be no simple way to compute the statistical 
significance of the final figures gained in Table III. On any 
one record, the difference between the per cents of recall of the 
most and the least recalled advertisements is more than four 
times the standard deviation of the difference. Any such signifi- 
cant differences tell us nothing of the strength of the appeals, as 
they may be due to differences in brand-names, or in the relative 
effectiveness of the two specific advertisements. However, there 
is an inferential way of showing that the total results represent 
a general trend running through all the records. It is possible 
to make a separate rank order of appeals for each product. 
These rank orders can be compared with the final rank order 
of appeals by computing rank difference coefficients of correla- 
tion. Positive coefficients would indicate a general superiority 
of certain appeals somewhat separate from that of particular 
brand-names or particularly skillful samples of copy. The 
coefficients are as follows: 





























Bathing suits 90 
Camera films 52 
Aspirin 43 
8 ne ean Al 
Shoes 32 
Chocolate bars 27 
Chewing gum 13 
Shampoo .06 
Watches .00 
Cigarettes —.46 





The fact that most of the coefficients are above zero seems to 
indicate that the general rank order of appeals given above 





ey pn ge cee oe 


Se gee ea EES OT 

















70 ©. E. OSGOOD, C. N. ALLEN AND H. 8. ODBERT 


has psychological meaning for this group beyond possible 
sampling errors. The outstanding exception is for ‘‘Mellow’’ 
cigarettes. The name seems to be so suggestive that the pro- 
portion of recall is equally high for almost all the appeals, thus 
obliterating the differences in appeal.® 

There might be an objection raised from the fact that we 
used different methods of presentation: sometimes two voices, 
sometimes one voice; sometimes a natural, sometimes an arti- 
ficially-pitched voice. As complete control of the method 
variable could not be achieved in a hundred advertisements, 
it was necessary to apply statistical corrections to be sure that 
the use of these different methods did not greatly alter the final 
results. These corrections are given in an appendix to this 
report. It will be seen that after correcting for the method 
variable, the only change was that economy and efficiency, 
which held seventh and sixth places respectively in our first 
list, exchanged their order. 

This experiment, then, assures us that as far as the ten 
products are concerned, and as far as the ten appeals are 
treated in our copy, Dartmouth students remember advertised 
products best if they are advertised with appeals of self-esteem, 
prestige, or health, and they remember products least if they 
are advertised with appeals of beauty, safety, and comfort. 

More general conclusions must be made only with regard for 
the following limitations inherent in our procedure. 

First, our subjects were a restricted group from one small 
sample of the population. It is possible that other samples 
would show different memory values for these same products 
and appeals. For example, an appeal such as ‘‘beauty’’ might 
be very effective with women. 

Secondly, our appeals included only ten universalized 
themes, and as such, eliminated other possible appeals such as 


6 It is interesting to note as a side light that the spread between the 
highest and the lowest recalls of brand-names is about two-and-a-half times 
as great as the spread between the highest and the lowest appeals. There- 
fore, we may say that differences in recall value of different advertise- 
ments in our experiment varied more with brand-name than with appeal 
factors. 
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mother-love, luxury, and the like. Another selection of ap- 
peals might have given a greater spread of differences. 

The final and perhaps most important limitation is that we 
cannot say that the self-esteen appeal is stronger im general 
than the appeal to comfort, despite the clear-cut difference 
shown in our data. Our definition of each appeal might not 
satisfy a jury of ‘‘experts.’’ We have consistently defined 
the universality appeal, for example, in the words of the copy 
itself: ‘‘in use all over the world’’ . . . “‘in countless Ameri- 
can homes’’. .. ‘‘many of your friends use it’... ‘‘pa- 
trons requesting it’’ . . . ‘‘well known to all’’.. . “‘all the 
other wise folks’’ . . . ‘‘approved by a million Americans.”’ 
These phrases were used in every advertisement including the 
appeal of universality. 

Beyond this restriction of appeals in terms of definition 
there is the further restriction in terms of samples of each 
appeal. Even with the most representative advertisements 
possible, a ‘‘population’’ of only ten advertisements is a small 
sample on which to base universal generalizations. We have 
attempted to carry the laboratory method to its logical conclu- 
sion with an elaborate control of variables, and yet this tech- 
nique, in itself practicable, has demonstrated that a general- 
ized ranking of universal appeals is dangerous. Probably the 
universal questions are not wisely asked.” 

7 Two possible extensions of our experiment may be mentioned. It 
would have been interesting, for instance, to have shown to our subjects 
a printed list of the ten appeals and then have them establish a rank order 
according to what they felt would be the most important of those appeals 
for themselves. Would this rank order have coincided with the rank order 
of appeals made evident by the experiment? 

Also, we included in our data sheet space for the subject’s hedonic 
reactions (the pleasantness or unpleasantness of each single advertise- 
ment as it was heard for a second time, after the original presentation 
and taking of recall data). Two types of correlations were used to find 
the relationship between the amount of recall and the hedonic tone. The 
first was to correlate the extent of recall with the extent of pleasant 
reaction. The second was to correlate the extent of recall with the extent 
of emotional reaction (whether pleasant or unpleasant). Both correla- 
tions came out approximately zero. This would appear to be definitely 
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PRACTICAL APPLICATIONS OF THE METHOD 


In spite of the limitations just mentioned, it seems that the 
; technique reported in this paper can be useful in a number of 
: more restricted problems. Two of them will be pointed out 
; briefly. 

(a) The rotation method may well be applied to fields other 
than advertising; it appears to be a basic technique for pre- 
testing the possible relationships between two major variables. 
(We have indicated that our third variable, methods, was a 
complication which will be omitted in future studies.) One 
problem that seems adapted to this technique is that of radio 
education, where the question is raised as to what material to 
use and how best to present it. In such a case, the form and 
content of the material for broadcasting may be all-important. 
Our technique offers a way of pre-testing each variable. We 
need only substitute content—the various subjects to be dis- 
} cussed on each program, such as history, economics, religion, 
psychology, or politics—for our variable, products; and meth- 
. ods of presentation—such as dialogue, dramatization, inter- 
view, or lecture—for our variable, appeals. In the case of 
radio education, we can repeat the present experiment in order 
to discover the best content and methods of presentation, pro- 
vided that the greatest care is observed in writing and check- 
i ing the copy to be tested. 

(b) Another application of our technique is suggested by 
i the fact that the rank order of appeals we obtained seems to 
hi characterize our particular student subjects. Our ranking 
emphasizes the social values (such as self-esteem, prestige, and 
| universality) rather than the alleged average selling values as 
i ranked, for example, by Hotchkiss.* Other groups of the 
| population, even students of other colleges, might yield quite 


, contrary to many of the statements made in our textbooks regarding the 

i positive and negative values of emotional appeals in advertising, and also 

7 contrary to the usually accepted theory that the recall of emotionally 
: reinforced items is greater than that of those not so reinforced. 

j 8G. B. Hotchkiss, An Outline of Advertising, 1933, 158. 
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a different rank order of appeals in a similar experiment. It 
is possible, therefore, that we have here a method whereby 
various differing groups may be tested as to their attitudes on 
social questions, without their knowledge of the purpose of the 
test. In this case we may have a new kind of concealed group 
attitudes test. 


SUMMARY 


An experiment was performed in which ten commodities 
were advertised by ten different appeals. A combination of 
each commodity with each appeal provided material for one 
hundred short commercial announcements which were recorded 
on acetate records and played to subjects so as to imitate the 
situation of commercial advertising over the radio. The effec- 
tiveness of each advertisement was measured by the proportion 
of people who could remember the name of the commodity 
advertised. The general strength of each appeal was measured 
by the average per cent of recall for all ten commodities. Self- 
esteem appeared as the best, and comfort as the poorest appeal. 
This list, then, characterizes the susceptibility of this special 
group of subjects to the different appeals used. Application 
of this method to other problems of radio research are mentioned 
in the paper. 


APPENDIX 


It was mentioned in the text that a special computation was 
made to eliminate the réle played by different types of presen- 
tation of advertisements in these records. The procedure is 
to be described in this appendix. The task was to make a 
series of progressive corrections so that we can interpret our 
data as if the appeals had appeared with a single product and 
a single method, and as if the average recall for all groups of 
subjects had been the same. Whereas in Table II the results 
were tabulated in such a way that each appeal deviated from 
the average of all appeals on each record, here we shall have 
each appeal deviating from the average of all appeals appear- 
ing with each product. The first step involved in these correc- 
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tions is the correction of data for different average recalls on 
each record : 
1. Add all ten per cents of recall for each record. (Columns, 
Table I.) 


2. Divide by ten to obtain average per cent recall for each 
record. 


8. Add the average per cent recalls of the ten records, and divide 


by ten to obtain the grand average per cent recalls for all 
records. 

4. Find the difference between the average per cent recall for 
each record and the grand average per cent recall for all 
records; these are plus or minus deviations. 

5. Apply the deviation for each record as a correction to the 
original per cent of recall for each advertisement on that 
record. 


(Add the amount of deviation to the per cent of recall 
if the deviation is minus; subtract if it is plus. Thus the 
average per cent of recall for Record I being .189 above the 
grand average per cent of recall, .189 is subtracted from 
each advertisement on Record I.) 


This gives us the per cent of recall for each advertisement 
(combining product, appeal, and method, and average per cent 
of recall variables) corrected for one variable: the different 
average per cents of recall by records, which make our data as 
if all ten records had had the same average per cents of recall. 

The same type of correction is used in three further steps. 
The next step is to make a rough correction for different average 
per cents of recall of different products. This preliminary cor- 
rection makes it possible to correct for methods which occurred 
unequally with each product. (Steps 1 through 5 are repeated 
as stated, substituting only the word product for record.) A 
third correction is for methods, and repeats the same general 
steps, but allowing for the fact that methods a and b occurred 
twenty rather than ten times. The final correction for products 
is again of the same type. This last is not a double correction 
but a progressive one, and is actually very slight. 

As a final result then, we get measures for the strength of 
the different appeals comparable to the one we obtained from 
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our original procedure. The following table compares the two 
series of figures. 


TABLE I 





Deviation from average per cent of recall 





First method Second method 





- .12 
41 
— .04 
35 
.68 
28 
- .19 
— .27 
—.70 
— 34 








MEASURING THE LISTENER’S ATTITUDE 
TOWARD A RADIO ART APPRECI- 


ATION COURSE 


F, J. ROOS 


Department of Fine Arts, Ohio State University 
AND 
L. M. HEIL 


Board of Examinations, Universvty of Chicago 


INTRODUCTION 


N the spring of 1938 the Department of Fine Arts of Ohio 
State University broadcast a series of twenty-four half- 
hour lectures on art appreciation, called ‘‘An Approach to 

Art.’’ The lectures went out over WOSU, the university sta- 
tion, at 10: 00 a.m. Tuesday and Thursday, and were repeated 
by transcription Wednesday and Friday at 9:45 p.m. Illus- 
trations of all the works of art discussed, ranging from pre- 
historic art to the modern gas stove, were printed in a twenty- 
four page pamphlet, available to listeners upon request. This 
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contained one hundred seventy-five illustrations averaging 
four square inches in size. 

The topics discussed were: the scope of art; the factors that 
make for aesthetic worth in architecture, sculpture, painting, 
and the minor arts; the relation of these factors to those in the 
allied fields of music and literature ; the current and changing 
forms of art; and art in the life of the average person. 

Since art appreciation is essentially visual and radio as an 
educational tool essentially auditory, the pamphlet was used 
in an attempt to bridge this gap. The listener was to refer to 
the illustrations during the lecture, since no other examples 
were used except those in the pamphlet. 


EVALUATION 


A questionnaire was sent to approximately 750 people who 
had written for the pamphlet. 

This group was assumed to be a part of the regular listening 
radio audience for this series. The purpose of the question- 
naire was two-fold: first, to determine the listener’s attitude 
toward, or appreciation of, this series of radio programs, and, 
second, to obtain some evidence as to how well the listener is 
able to apply that information imparted through the programs 
to judge certain pieces of art. The responses to the question- 
naire were to be anonymous, although one-third of the group 
answering the questionnaire made their identity known through 
their signatures. 


THE DEFINITION OF APPRECIATION OF THIS SERIES OF 
RADIO PROGRAMS 


Appreciation of this series of programs is defined in terms 
of questions falling into six broad types: 


A. Satisfaction in listening to the broadcasts. 

B. Desire for more broadcasts of the same kind, or for ex- 
periences closely related to the content of the broad- 
casts. 

C. Appreciation as revealed by a desire to know more about 
those topics discussed in the broadcast. 
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D. Appreciation as revealed by desire to express one’s self 
creatively as a result of the broadcasts. 

E. Appreciation as revealed by the listener’s identification 
of himself with the content included in the broadcasts. 

F. Appreciation as revealed by desire on the part of the 
listener to clarify his own thinking with regard to 
certain life problems related to the content of the 
broadcasts. 


A. Satisfaction in Listening to the Broadcasts 


Two groups of questions were asked under this general 
heading. One group of questions was designed to obtain some 
evidence concerning the listener’s subjective feeling about the 
programs; the other group was devised to obtain evidence con- 
cerning those activities which the listener would carry on if he 
were to exhibit satisfaction in the programs. Typical ques- 
tions representing the first group of questions, namely, the 
questions to obtain the listener’s subjective satisfaction in 
listening to the broadcasts, were the following: 

**Do you feel that some aspects of the broadcast talks will be 
incorporated in your leisure-time activities, for example, reading, 
modeling, painting, home decoration, ete.?’’ 

**Would you prefer to have the broadcasts reduced to fifteen 
minutes?’’ 

‘Were there times during the series of talks when you felt indif- 
ferent about them?’’ 


The questions designed to reveal what the listener did in 
showing his satisfaction in listening to the broadcasts were of 
the following types: 


**Did you, as a result of this series of broadcasts, talk with sou:e 
one else about them, or encourage them to listen to the broadcasts?’’ 

‘*Did you make notes of certain statements or passages during 
the broadcasts which seemed to you very interesting?’’ 


B. Desire for More Broadcasts of the Same Kind, or for 
Experiences Closely Related to the Content 
of the Broadcasts 


Typical questions devised to reveal how a listener would 
show appreciation of this kind subjectively were: 





PE eee 





or 7 Bayes heey 


9 2 eet a 


PET 0 eat 


PRR 





posierenpe 


rma 


perenne 





peers a 
ee ee ee ee 

















78 F. J. ROOS AND L. M. HEIL 


**Do you believe that you will attend any lectures which are closely 
related to the topics of this series of broadcasts?’’ 

**Do you believe that, as a result of these broadcasts, you will 
read more than you have in the past about art?’’ 


Questions devised to contain evidence about what the lis- 
tener did who showed this aspect of appreciation were: 
‘* As a result of the broadcasts, did you visit an art gallery?’’ 


‘*Did you attempt to discover any other broadcasts of a similar 
kind to which you might listen?’’ 


C. Appreciation as Revealed by a Desire to Know More About 
Those Topics Discussed in the Broadcast 


Subjectively this aspect of the listener’s appreciation was to 
be revealed by answers to such questions as: 


**If some of the materials or expressions used in the broadcast 


were not clear, did you attempt to clarify their meanings by your- 
self?’’ 


**Do you believe that you would like to make a collection of cer- 
tain kinds of articles as suggested by the talks?’’ 


Objectively or in terms of those activities which might be 
expected of a listener if he were to reveal this aspect of ap- 
preciation, the following questions are typical: 

**Did you at any time during the series of the broadcasts visit a 
library to obtain books which would give you more information about 
those topics included in the talks?’’ 

‘*Are you keeping a file or serapbook in which you are incorpo- 
rating newspaper articles, magazine articles, or illustrations which 
have a bearing on the topics discussed?’’ 

‘*Have you purchased any books which were suggested in the 
talks?’’ 


D. Appreciation as Revealed by Desire to Express One’s Self 
Creatively as a Result of the Broadcasts 
The following questions are typical of those devised to re- 
veal the subjective aspect of this type of appreciation: 
**Have you a desire after listening to this series of broadcasts to 


indulge in some creative activity such as painting, modeling or pho- 
tography?’’ 
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** Would you like to organize a group in your community for the 
purpose of discussing certain aspects of art or its appreciation?’’ 


Objectively the presence or lack of this aspect of appreci- 
ation on the part of the listener should be revealed by answers 
to questions of which the following are typical: 


**Did you attempt to do any painting or modeling yourself in 
which you tried to incorporate some of the ideas suggested by the 
instructor?’’ 

‘*Have you at any time attempted to make a description of some 
of the pictures included in the accompanying manual in terms of 
those elements most stressed in the broadcast?’’ 


E. Appreciation as Revealed by the Listener’s Identification 
of Himself with the Content Included in the Broadcasts 


This aspect of appreciation was to be revealed by such 
questions as: 


**Do you feel that the interpretations of works of art or things in 
your everyday living will be different as a result of listening to the 
broadcasts from your interpretations of the same things before you 
listened to the broadcasts?’’ 

**Do you feel that your vocabulary and understanding of art have 
been increased as a result of the broadcasts?’’ 


Objectively this aspect of appreciation ‘was to be revealed 
by questions of which the following are typical: 


**As a result of the broadcasts, have you condemned certain pic- 
tures or works of art on the basis of that information which you 
received in the broadcasts?’’ 

**Did you find in the discussion with other people that you were 
using the same method of explanation of a work of art as that which 
was used in the broadcasts?’’ 


F. Appreciation as Revealed by Desire on the Part of the 
Listener to Clarify His Own Thinking with Regard to 
Certain Life Problems Related to the Content 
of the Broadcasts 


The questions devised to reveal the presence of this aspect 
of appreciation were all of the subjective type. The following 
questions illustrate how this aspect of appreciation was defined : 
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**Have you thought about ‘right answers,’ or ‘final answers,’ to 
eurrent problems of living, in the same way that they were presented 
about art in the broadcasts?’’ 

‘*As a result of the broadcasts, were you able to see a closer rela- 
tionship between art, music, and literature?’’ 

** As a result of the broadcasts, have you changed your beliefs con- 
cerning the standards which are to be used in judging a work of 
art?’’ 


APPLYING THE INFORMATION GIVEN IN THE PROGRAMS IN 
JUDGING CERTAIN PIECES OF ART 


In this part of the questionnaire, a short objective test was 
devised to determine how well the listener could apply the 
information given in the broadcasts to make judgments con- 
cerning : 

a. Which is the better of twe different works of art, and 

b. The listener’s knowledge of the standards which may be 

used for judging works of art. 


RESULTS OF THE QUESTIONNAIRE 


Of the 750 questionnaires, 125 were returned by the lis- 
tening group. These responses seem to indicate that any in- 
terpretations made of the results probably involve a doubly 
selected group of listeners. The first selection is probably rep- 
resented by those 750 listeners who were sufficiently interested 
in the subject of art to write for the booklet which was de- 
veloped to make the broadcasts more meaningful. This is not 
altogether true, of course, since many listeners will write for 
any gift offered by a broadcasting station or a sponsor. The 
second selection is probably represented by that group of 
listeners who were sufficiently interested to answer the question- 
naire. 

There were 45 questions in the 6 categories of the question- 
naire in which it was possible for a person to reveal the pres- 
ence or lack of his appreciation of the series of broadcasts. In 
grading the questionnaire a grade of ‘‘1’’ was given for each 
of the ‘‘desirable’’ responses to the 45 questions. The analy- 
sis of the returns showed that the scores ranged from 42 to 10 
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with a median value of 27. Analysis of the returns to the 
questionnaires as they were received also shows that the 
median value of appreciation of the broadcasts as determined 
in the questionnaire did not change to any appreciable extent 
with succeeding returns. This point was checked by scoring 
groups of 25 questionnaires in chronological order as they were 
returned. 

The following table gives the median values for the various 
types of appreciation as defined in the questionnaire. 
1. Satisfaction in listening to the broadcasts 00cm 75% 


2. Appreciation as revealed by a desire for more broadcasts of 
the same kind or for more experiences as closely related to 





the content of the broadcasts on... ccccccccccccccccoccsesicssssernenscnnsenenen 67% 
3. Appreciation as revealed by the desire to know more about 
those topics discussed in the broadcasts . - . 46% 


4. Appreciation as revealed by a desire to express | emeself « crea- 
tively as a result of the broadcasts nn cccccccccnnnnenennnnnnnnen 41% 
5. Appreciation as revealed by the listener’s identification of him- 
self with the content of the broadcasts i cccceccccecemnncnmmenenee 68% 
6. Appreciation-as revealed by a desire on the part of listeners to 
clarify their thinking with regard to certain life problems 
related to the content of the broadcasts 


These percentages represent the ratio of the total number of 
desirable responses in each of the six categories to the total 
number of possible desirable responses. The percentages also 
include the listeners’ responses to both types of questions, 
namely, those designed to reveal subjective appreciation and 
objective appreciation. 

The responses of the group to questions of the subjective 
type differed markedly from the responses to those questions 
which were designed to reveal objective appreciation of the 
radio series of programs. The group as a whole indicated an 
objective type of appreciation by giving a desirable response 
to 39 per cent of the questions which were designed to reveal 
that type of appreciation, whereas the desirable responses of 
the group to questions designed to reveal subjective apprecia- 
tion were found to be 70 per cent of the total number of oppor- 
tunities. 
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The specific responses of a group of 125 who answered the 
questionnaire may be made more clear through the analysis of 
seven of the ‘‘subjective’’ and ‘‘objective’’ questions. The 
following table gives the response of the group of 125 to these 
two types of questions, the numbers representing percentages 
of the group who answered ‘‘Yes,’’ ‘‘No,’’ and ‘‘ Uncertain.’’ 





Uncer- 
Yes No ara 





Objective Questions 
**Did you, as a result of this series of broadcasts, talk 
with some one else about them or encourage them 
to listen to the broadcasts?’’ 92 7 1 
**Did you make notes of certain statements or passages 
in the broadcast which seemed to you to be very 








interesting ?’’ 81 17 2 
‘*As a result of the broadcasts, did you visit an art 
gallery?’’ 31 69 - 0 





‘*Did you at any time during the series of broadcasts 

visit a library to obtain books which would give 

you more information about these topics included 

in the broadcasts?’’ 32 «68 0 
‘*Are you keeping a file or scrapbook in which you 


are incorporating newspaper articles, magazine 
articles or illustrations which have a bearing on 





the topics discussed in the talks?’’ .................... 32 «68 0 
‘Have you purchased any bodks which were migge> 
tive of the broadcasts?’’ 14 86 0 





**Did you attempt to do any painting or modeling 
yourself in which you tried to incorporate some 


of the ideas suggested by the instructor?’’ ....... 22 78 0 
**Have you used any quotations from the talks in any 
writing or talking which you have done?’’....... 43 45 12 
Subjective Questions 
**Would you prefer to have had the broadcasts re- 
duced to fifteen minutes?’’ 4 92 4 





**Do you feel that some aspects of the talks will be 
incorporated in your leisure-time activities, for 
example, reading, modeling, painting, home deco- 
rations?’’ 90 7 3 
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Yes No Uneer- 





**Do you believe you will attend any lectures which 

are closely related to the topics in this series of 

broadcasts?’’ 32 «(557 11 
**Would you like to organize a group in your com- 

munity for the purpose of — certain 

aspects of art or its appreciation?’’ .......... 70 829 1 
‘*Have you a desire after listening to the series : of 

talks to indulge in some creative activity—paint- 

ing or modeling or photography??? ccm 70 8629 1 
**Do you feel that you will interpret works of art or 

things in your everyday life in a way different 

from that which you had been previously (before 

the broadcasts) interpreting them?’’ ........................ 90 5 5 
‘*As a result of the talks have you changed your be- 

liefs concerning the standards of art which are to 

be used in judging a work of art?’’ 71 #19 10 








From one point of view the responses to the questionnaire 
do seem to indicate that the appreciation of the listening group 
to the broadcasts was a rather superficial one; that is, most of 
the group seem to like the broadcasts and do have good inten- 
tions about doing something as a result of the series of broad- 
casts, but the responses to the objective-type questions seem 
to indicate that not much had actually been done as a result 
of the broadcasts. This inference may be documented by the 
relatively low percentage of desirable responses to questions 
of the objective type and the relatively high percentage of 
desirable scores on questions of the subjective type. There is 
always the possibility, of course, of a group of listeners who 
did many things as a result of the broadcasts but which was 
not revealed because this group might be reluctant to answer 
the questionnaire. From another standpoint, however, the 
responses to the subjective type of questions might be inter- 
preted by those who are responsible for the broadcasts as in- 
dicative of a high degree of success for this type of broadcast. 
For example, the broadcaster of this series of programs might 
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very well consider that one of his purposes has been success- 
| fully achieved if as many as thirty-one per cent of the listeners 
if were stimulated to visit an art gallery as a result of the broad- 
i casts or if thirty-two per cent were stimulated to visit a library 
for the purpose of obtaining more information about the topics 
| included in the broadcasts. This last type of interpretation, 
a of course, should be made with caution since it is probable that 
if the persons answering the questionnaire represented a doubly 
| selected group, the first selection occurring on the basis of their 
) interest in writing for the booklet, and the second, their inter- 
est and cooperation in answering the questionnaire. 

When the scores of individual listeners on the 16 questions 
designed to reveal objective appreciation were compared with 
the scores of the same listeners on the remaining 29 questions 
designed to reveal subjective appreciation, it was found that 
the correlation between these scores was .68. If we assume 
honesty on the part of the listener in answering the questions 
of the objective type, this correlation seems to give consider- 
able weight to the validity of the subjective questions used in 
the questionnaire to measure the listener appreciation of the 
series of programs. 

By means of the questionnaire, data were also gathered con- 
cerning the following characteristics: age, sex, and time at 
which listening began. When these factors were compared 
with the appreciation scores computed from the question- 
naires, it was found that appreciation did not seem to depend 
ii) upon age or sex. There was a slight tendency, however, for 
i those who began listening early in the series to show a greater 
| appreciation than those who began with later talks. Further 
analysis of the returns showed that the appreciation scores 
; bear no relationship to the scores made by the same individuals 

| when they were asked to apply principles given in the broad- 
F easts for judging various kinds of art. 
Hi The chief value of this study is that it introduces a worth- 
| while technique which may be elaborated in further investiga- 





ee ee ~ = fe 
<ALL LATO ett NN atten tnt eee nc 


tions of this kind. It will be useful primarily in ascertaining 

















SELECTION AND ENJOYMENT OF PROGRAMS 85 


the relative effectiveness of two different types of radio presen- 
tation. To make a final statement about the effectiveness of 
the particular series of radio programs used in this study, we 
should therefore have a comparable series using a method of 
presentation other than the straight-talk or lecture type. 


FAMILIARITY AS A FACTOR IN DETERMINING 
THE SELECTION AND ENJOYMENT OF 
RADIO PROGRAMS 


HADLEY CANTRIL 
Princeton University 
AND 
HAZEL GAUDET 
Princeton Radio Research Project 


Editorial Note: Dr. Cantril, along with Dr. Frank Stanton of 
the Columbia Broadcasting System, is an Associate Director of 
the Princeton Radio Research Project. 

HE effect of familiarity in learning and in the formation 
of aesthetic judgment has been the subject of numerous 
inquiries. Although no final conclusion can be drawn 

from the studies because of the variety of their methods and 
conditions, it is perhaps sage to say that when a subject is pre- 
sented with a familiar stimulus, the Zinstellung thereby aroused 
facilitates the process of learning subsequent materials and 
tends to make aesthetic judgments more positive.* 

In order to learn the extent to which familiarity with material 
to be broadcast determined the extent to which the broadcast 
would be tuned in as well as the enjoyment of the program, two 
experimental situations were set up: one with questionnaires 
mailed to an adult listening audience, the other with question- 
naires administered to a group of adolescents in high school. 
Since the procedure and results of the experiments varied, they 
will be described separately. 

1 Examples of recent studies indicating these trends are: H. Cason, 
** Associations between the Familiar and the Unfamiliar,’’ Journal of 
Experimental Psychology, 16, 1933, 295-305; A. H. Maslow, ‘‘The Influ- 


ence of Familiarization on Preference,’’ Journal of Experimental Psy- 
chology, 21, 1937, 162-180. 
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EXPERIMENT I 


Procedure. With the cooperation of station WNYC, it was 
arranged that three rather familiar plays should be broadcast 
at different times. The plays chosen were ‘‘A Doll’s House,’’ 
**School for Scandal,’’ and ‘‘School for Husbands.’’ Some 
weeks previous to the broadcasts, the names and addresses of 
persons who had borrowed these plays from various New York 
Public Libraries within a three-year period were obtained. 
Three days before the broadcast of each play, cards were sent 
to 250 of these persons as well as to an equal number of people 
using the library facilities but who had not presumably read 
the play in question, making a total of 500 for each play. These 
ecards merely informed the individual that the play would be 
broadcast over WNYC at a particular time. The day after the 
broadcast, cards were again mailed to these same people asking 
them the following questions : 

1. Did you listen last night to the radio dramatization of (name of 

t 

2. a how much did you enjoy the broadcast? Very much... ‘ 
Somewhat... Not at all... 

Did you listen to the whole broadcast .......... or only to a part of 
RonF 

Had you read the play before you heard it broadcast? 

Had you ever seen the play on the stage or screen? 

Did you listen to the broadcast because you were previously notified 
that it would take place? 


Replies were received from 203 persons or 27.1 per cent who 
had read the play in question, and from 131 or 17.5 per cent 
who had not. All of the persons who were selected as ‘‘fa- 
miliar’’ with a play by reason of the library records, proved to 
be familiar in their replies to the questionnaire. 

Results: Table I indicates that there was no significant differ- 
ence in listening between the percentage of those who had read 
the play and those who had not. 

Table II indicates that a greater percentage of those who had 
not seen the play listened to the broadcast than of those who had 
seen the play. 


2 
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Table III indicates that the ratio of those people presumably 
most familiar with the play before the broadcast (those who had 
both seen and read the play) who listened to the program was 


TABLE I 
Composition of the Reading and Non-Reading Groups with Respect to 
Listening 





Listened Did not listen Total 
Number Percent Number Percent Number Percent 








BD eicrcrtncions > 56 96 44 220 100 
Has not read 60 52 40 131 100 





TABLE II 
Composition of the Groups Who Had and Had Not Seen the Play with 
Respect to Listening 





Listened Did not listen Total 
Number Percent Number Percent Number Percent 








SE siicidencniontinn, © Se 46 50 54 93 100 
Had not seen ... 160 62 98 38 258 100 





smaller than the ratio of those who listened and who were only 
semi-familiar or totally unfamiliar with it 


TABLE III 
Composition of the Reading and Non-Reading Groups Combined with 
Those Groups Who Have Witnessed the Play and Those Who 
Have Not with Respect to Listening 





Listened Did not listen Total 
Number Percent Number Percent Number Per cent 








Read—seen ............... 34 42 46 58 80 100 
Read—not seen ...... 90 64 50 36 140 100 


9 4 31 13 100 
Not read—not seen 70 59 48 41 118 100 





Table IV reveals no difference in the amount of the broadcast 
heard by those who had and who had not read the play. 
Table V shows that there is a tendency on the part of those 
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who are familiar with a play to rate their enjoyment of the radio 
performance in a more extreme way (either positively or nega- 
tively) than did those people unfamiliar with the production. 























TABLE IV 
Amount of Programs Heard by Those Who Had Read the Plays and Those 
Who Had Not 
Listened to 
Whole Part No answer Total 
Per Per Per Per 
Number cent umber cond Number pacer Number eins 
Read ..... 99 80 23 19 2 1 124 100 
Not read. 61 77 13 17 5 6 79 100 
TABLE V 
Extent to which the Programs were Enjoyed by Those Who Had Read the 
Plays and Those Who Had Not 
Enjoyed 
Very much Somewhat Not at all Total 





Per Per Per Per 
Number portent Number cent umber ome Number eant 





Read ..... 78 63 37 30 9 7 124 100 
Not read. 43 54 33 42 3 4 79 100 





TABLE VI 
Eatent to which People Listened Because They Were Notified That the 
Program was to be Presented 
Yes No Total 
Number Percent Number Percent Number Per cent 











Did you listen 
because you 
were notified? 140 93 10 7 150 100 





* The cards on the play, ‘‘School for Husbands,’’ did not eontain this 
question. 
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Table VI gives a rather unexpected but significant finding, 
namely, that over 90 per cent of the people who listened to the 
broadcast, did so because they were notified in advance. 


EXPERIMENT Ii? 

Procedure: With the cooperation of Station WOR, studies 
were made of the radio interests of high-school students. As a 
part of a larger survey,’ it was possible to study the influence of 
familiarity with the play on the amount of listening and the 
degree to which the play was liked.* A group of 500 high- 
school students’ which had been cooperating in the survey for 
five successive weeks previously was divided into two groups, 
each containing the same proportions of students in each year 
in school and approximately equally divided as to sex. The 
radio script was read in class to 235 students, while 265 did not 
hear the play read. To both groups the announcement was 
made in class that the play was to be presented over the radio 
the next day as part of the regular series of dramatic broadcasts 
to which they had previously been invited to listen. At the next 
session of the classes identical questionnaires were administered 
to both groups concerning their reactions to the radio drama. 

Results: Table VII shows that in the familiar group, the 
number of those who listened to its radio performance is much 
greater than in the unfamiliar group. A significant sex dif- 
ference is also revealed: A greater propurtion of girls than boys 
listened to the broadcast, whether they were familiar with it 
or not. 

Table VIII indicates that of those who listened to the radio 


2 Acknowledgment is made to the National Youth Administration for 
clerical assistance in this portion of the study both in the preparation of 
the questionnaires and the analysis of the results. 

8 The complete study will be published in a separate monograph of the 
Princeton Radio Research Project. 

4 The play, which was presented by students of another high school, was 
a relatively unknown one, ‘‘ The Game of Chess,’’ by Kenneth Goodman. 

5 The study was made possible by the cooperation of Dr. Max Herzberg 
and Dr, William Lewin, of Weequahic High School, Newark, New Jersey. 
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presentation, those who had heard the script read before they 
heard it on the air liked the radio play a great deal more than 
those to whom the radio play was entirely new. Since the sex 


TABLE VII 


Eatent to which the Play was Heard by Those to Whom the Play Had Been 
Bead and Those to Whom It Had Not Been Read 

















Listened Did not listen 
Total Total 

Males Females Per Males Females Per 

Number ont Number cont 
Heard play 

read ....... 48 87 135 58 52 48 100 42 
Did not hear 

play read 22 55 77 29 93 95 188 71 





differences in this regard were negligible, both sexes are com- 
bined in this table. 
TABLE VIII 
Degree to which the Play was Liked by Those to Whom the Play Had Been 
Read and Those to Whom It Had Not Been Read 
Per cent liking play Total 


Vi Fairly Not No 
well well atall answer Percent Number 

















Heard play read 49 40 8 3 100 135 
Did not hear play 
read 16 65 13 5 100 77 
CONCLUSIONS 


(1) Adults listened to the special dramas more because they 
were notified in advance of the broadcasts than because they 
happened to be familiar with the particular plays. This may 
be due in part to the fact that the radio plays appeared on a 
station to which there is a relatively small audience. If they 
had been presented on a station to which many people listen 
habitually perhaps the per cent who listened because they were 
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notified might not have been so high. Competing interests of 
both a radio and non-radio variety, together with other demands 
on the time of the adult, probably reduced almost to nothing 
the influence of familiarity as a factor determining the interest 
in ‘these programs. It might reasonably be expected that if a 
broadcast were to include one of an individual’s favorite dramas 
or some other familiar content closely involved in an individ- 
ual’s personal aspirations, interests, tastes, or associative back- 
ground, then this familiarity would be a determining factor in 
the choice of programs.® In other words, if an individual has 
a positively toned attitude toward a specific experience, if this 
attitude entails a certain ego-involvement, then the individual 
will seek a renewal of that experience, providing no other atti- 
tudes conflict or are more intense, and providing no other mo- 
tives, whether enduring or temporary, force behavior into other 
channels.’ 

The fact that those people who had both seen the play and 
read it listened less than others may be due to several factors: 
(a) they may be sophisticated persons for whom the radio 
drama is a poor substitute for the original; (b) they may be 
more active individuals with a greater number of competing 
interests; (c) they may have felt that they were sufficiently 
acquainted with the play and would prefer to hear something 
new if they listened to the radio at all. 

(2) The adolescent group showed a marked tendency toward 
more listening in the group to which the play had been read 
aloud before the broadcast. The greater percentage of girls 


6 The role of familiarity in determining the selection of musical broad- 
casts and the choice of radio news commentators will be examined in detail 
in separate volumes of the Princeton Radio Research Project. 

1 Cf. H. Cantril, ‘‘ General and Specific Attitudes,’’ Psychology Monthly, 
1932; ‘‘The Prediction of Social Events,’’ Journal of Abnormal and 
Social Psychology, 33, 1938, 364-389. 

8In accepting this result the honesty of the subjects must also be as- 
sumed. The extent to which individuals who were familiar with the play 
would be inclined to falsify their replies can only be conjectured, since 
they would have been abie to answer questions on the content of the play 
without having heard it on the radio. The number who would do this is 
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than boys who listened to the broadcast is probably due to the 
greater conscientiousness of girls in following a teacher’s sug- 
gestions, as well as to their comparative lack of competing 
leisure interests and employment.® The group familiar with 
the content of the play liked the play better. The drama was 
Russian, was performed with accents, and the script jumped 
rather immediately into the plot of the story, so that it was 
probably a great deal easier to understand, and consequently 
to like, if the subject knew what was coming. 

(3) The chief factor which probably accounts for the dif- 
ferent results obtained in these two experiments is the differ- 
ence in the way in which the data were collected. The adult 
questionnaires were collected by mail, so that only a certain 
percentage of the original list returned answers. The high- 
school questionnaires were administered through the school so 


_ that every individual who was questioned returned his ques- 


tionnaire. It is probable that the familiar group of adults who 
were sufficiently interested to listen to the broadcast would also 
be the most interested in returning their questionnaires. Those 
who were familiar but did not listen, and those who were not 
familiar but did listen, might reasonably be expected to fall in 
the middle as to interest, and would both probably return fewer 
questionnaires than the first-mentioned group. Finally, the in- 
dividuals who were not familiar with the play in question and 
who also did not listen to the broadcast, would also be expected 
to be in the group least interested in returning their question- 


probably small. Another play in the same series failed to go on the air 
at the last moment. The questionnaires were already in the hands of the 
subjects, and since this particular broadcast was the first day of Easter 
vacation, they had been asked to mail their questionnaires in, contrary to 
the usual procedure of collecting them in the classroom. Only 12 indi- 
viduals of the 500 odd who received questionnaires, said they had heard 
the broadcast, or 4.3 per cent of the 273 individuals who returned ques- 
tionnaires in spite of the fact that the broadcast did not go on the air. 
Since this was part of the same group as reported in the present study, it is 
not probable that the falsification would be any more widespread here. 
® The plays were broadcast on Saturday mornings when many of the boys 
were employed. 
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naires. The situation may be presented more graphically in 
the following illustration : 











Liutening Not listening 
Familiar A B 
Unfamiliar Cc D 








In the above diagram, group A could reasonably be expected to 
return the greatest proportion of questionnaires, and group D 
the least; groups C and B would probably fall somewhere in 
between in the per cent returned. In Table I it was seen that 
56 per cent of those who were familiar, listened to the broadcast, 
while 60 per cent of the unfamiliar did likewise. It is highly 
probable that the proportion of the unfamiliar who listened was 
so high, not because more of the unfamiliar actually did listen, 
but because fewer of the unfamiliar returned their question- 
naires (D group), thus making the C group larger by com- 
parison. 

In the high-school experiment this situation did not arise 
since the questionnaires were all administered by teachers in the 
classroom and every questionnaire of the A, B, C, and D groups 
alike were collected. There are, of course, other factors which 
might account in part for the difference between these two 
experiments although they are of small importance in com- 
parison with this difference in technique. It may be that the 
individuals at the younger age level Lave fewer enduring in- 
terests, thus allowing recently derived interests (such as radio) 
a greater role in determining behavior. The prestige of the 
teacher’s suggestion that the play would be broadcast would 
undoubtedly constitute a powerful motivating force toward 
listening which was absent in the study of the adults. Not 
only would the teacher’s suggestion bear weight with high- 
school students, but the fact that the teacher spent five or ten 
minutes of the class time on this particular dramatic produc- 
tion might even suggest that this play had a certain cultural 
value. 

(4) Probably the most important conclusion to be derived 
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from the present studies is that the role of familiarity in deter- 
mining radio tastes can be fully understood only if similar ex- 
periments are conducted, making use of a variety of programs 
and subjects. The diverse results obtained in these two studies 
point to the imperative need of holding the experimental meth- 
ods constant in any further studies before any conclusions can 
be drawn. The backgrounds, interests, and leisure-time activi- 
ties of listeners should also be thoroughly examined. The value 
of the present inquiry is, then, essentially in its contribution to 
methodology more than in its contribution to existing data on 
the subject. 





Section III. Questionnaire Technique 


Editorial: Much has been written about questionnaires, and 
radio research adds to the body of accumulating experience. It 
is from the point of view of quantity that some of the contribu- 
tions in this section are remarkable. The first and last papers 
shows results based on samples which applied psychologists have 
not previously had at their disposal ; in the course of audience 
surveys many questionnaire problems can now be settled—prob- 
lems which formerly were matters merely of conjecture because 
special studies would have been practically impossible. The 
paper on articulation, incidentally, seems to approach a problem 
which has not yet been discussed. 


NOTES ON THE VALIDITY OF MATL 
QUESTIONNAIRE RETURNS 


FRANK STANTON: 
Director of Research, Columbia Broadcasting System 


Editorial Note: Dr. Stanton, along with Dr. Hadley Cantril 
of Princeton University, is an Associate Director of the Prince- 
ton Radio Research Project. 


ITH the widespread use of the mail questionnaire by 

\X/ business concerns, research agencies, and govern- 
ment bureaus, the problem of who returns question- 

naires deserves attention. There is scattered evidence in the 
literature? which confirms the convictions of several research 


1 The writer wishes to acknowledge the contributions of Mr. Oscar Katz, 
Columbia Broadcasting System, in preparing the tabulations for this 
paper. 

2 Among the more recent discussions see, American Marketing Associa- 
tion, The Technique of Marketing Research. New York: McGraw-Hill 
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workers to the effect that selective factors can operate in mail 
surveys to produce definite bias in the returns. 

It is generally known, for example, that in mail surveys 
whole segments of the population may be missed almost com- 
pletely. In certain mail surveys, because of the appeal of the 
questionnaire, only middle-class recipients return the forms. 
It must be assumed in any mail study, from the outset, that 
one foregoes the responses of non-readers and non-writers. 
Furthermore, it is very difficult to determine the representa- 
tiveness of the respondents, not meaning in this case the re- 
sponsiveness of all income or occupational groups, but rather 
whether those who do reply are representative of those who do 
not answer the request for information. 

Responses to a form may be confined to those who are inter- 
ested in the subject of the inquiry. Interest in some cases may 
result from use of the product under question. Salisbury re- 
ports distortion of this nature in a test made by an industrial 
concern which showed that ‘‘92 per cent of the respondents to 
a mail questionnaire were users of the product, while 40 per 
cent of those who did not reply were users.’’ 

The following analyses of special mail returns throw some 
light on the problems of the effect of use and interest as weli 
as the representativeness of the respondents. The data are based 
on returns to a three-page mail questionnaire sent to a repre- 
sentative list of 11,169 U. 8. school teachers inquiring among 
other things about their possession and use of classroom radio 
receiving facilities. 

Out of the original mailing, usable replies were received 
from 3,159, or 28.3 per cent, of the teachers. In an effort to 
determine the influence of ownership of classroom radio facili- 
Book Company, Inc., 1937, p. 62 ff. Lyndon O. Brown, Market Research 
and Analysis. New York: The Ronald Press Company, 1937. J. David 
Houser, ‘‘ Measurement of the Vital Products of Business,’’ Journal of 
Marketing, II, 3 (January, 1938), pp. 181-189. Philip Salisbury, ‘‘18 
Elements of Danger in Making Mail Surveys,’’ Sales Management, 
XXXIV, 4 (February 15, 1938), pp. 28, 30, 84, 85. Richmond Watson, 
‘‘Investigations by Mail,’’ Market Research, VII, 5 (November, 1937), 
pp. 11-16. 
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ties (the subject of the questionnaire) on the speed of response, 
an analysis was made of the first and second halves of the re- 
spondents for this factor. In Table I, the first half to respond 
is compared with the second half. 


TABLE I 
Ownership of Classroom Radio Facilities by First 50 Per Cent and 
Last 50 Per Cent of the Total Respondents 





Teachers with 
classroom radio : 
Number facilities Diff. 
Portion ofsample ofcases No. Pet. Diff. oDiff. oDiff. 


First 50 per cent... 1,580 574 36.3% 
Last 50 per cent... 1,579 575 364% %% 171% .06 








REE - sgtd 1.149 36.4% 





From Table I it can be seen clearly that the first 50 per cent 
of the responding teachers do not possess classroom radio facil- 
ities to any greater extent than the second 50 per cent. The 
actual difference in percentage of ownership is 0.1 per cent in 
favor of the second half—a difference which is not statistically 
significant as demonstrated by the extremely small critical 
ratio of .06. 

This same condition is reflected in Table II, where the cumu- 
lative returns are summarized for the two halves of the re- 
sponding sample by five-day intervals. Examination of Table 
II will reveal how closely the owners and non-owners of class- 
room radio facilities parallel each other in their returns, step 
by step. 

Assuming that the greatest difference in ownership might be 
found between the first 95 per cent to respond and the last 5 
per cent, the data were analyzed further on that basis. The 
results are shown in Table III. 

The difference percentagewise in radio facility ownership, 
although greater between the first 95 per cent and the last 5 
per cent than between the first 50 per cent and the last 50 per 
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TABLE II 
Questionnaire Returns at Five-day Intervals 
(First Study—No Follow-Up) 








Number of days Questionnaires returned el 
after sending Teachers with Teachers without 
classroom classroom 
to respondents teachers radio facilities radio facilities 
De intincas 43.5%* 43.21% 43.6%t 
I ee 74.6 75.7 73.9 
BD vatican 84.0 85.8 83.1 
OR ice 87.8 88.7 87.3 
a 92.3 93.3 91.4 
RRC 94.8 95.4 94.5 
UN iksninhites 95.9 96.4 95.7 
Ppa 96.6 96.6 96.4 
OP ees 97.2 97.5 97.0 
__ eae 97.7 97.7 97.7 
eae 98.0 97.9 98.1 
OD cette 98.5 98.6 98.5 
OB stickies 98.7 98.8 98.6 
, ee 99.0 99.1 99.0 
1 STE 99.3 99.2 99.3 
OF cecatsnicah 99.4 99.4 99.4 
OF ivtiiincs. 99.5 99.7 99.5 
OO dioica, 99.6 99.7 99.5 
Se 99.6 99.7 99.6 
Baa 99.7 99.8 99.7 
Wh Wit 99.8 99.9 99.8 
} SES 99.9 99.9 99.9 
1 Are 99.9 99.9 99.9 
UE i oscnics 99.9 99.9 99.9 
TE iisienss 100.0 100.0 100.0 





* 100% = Total number of avestionnaires returned. 

t 100% = Total responses from teachers with classroom radio facilities. 

+100%=Total responses from teachers without classroom radio 
facilities. 





lS i crate os he we te 
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TABLE III 
Ownership of Classroom Radio Facilities by First 95 Per Cent and 
Last & Per Cent of the Total Respondents 





Teachers with 
classroom radio F 
Number facilities Diff. 
Portion ofsample ofcases No. Pet. Diff. oDiff. oDiff. 


First 95 per cent... 3,001 1,098 + 36.6% 
Last 5 percent... 158 51 323% 43% 3.93% 1.09 








3,159 1,149 36.4% 





cent, is small and according to the critical ratio not significant 
statistically. On the basis of these data, one might assume 
that for certain factors the investigator need not wait for com- 
plete returns to begin his analyses.* 

The data obtained in this study also afforded an opportunity 
to study the effect of use of classroom facilities on the speed of 
response. For this purpose the first and last halves of the total 
respondents were compared regarding use of the facilities 
owned. The results of this comparison are presented in Table 
IV. 

Thus from Table IV it is evident that the first half of the 
responding teachers who own classroom radio equipment do 
not use their facilities to any greater extent than those re. 
sponding in the last half of the sample. 

To obtain more information on this aspect of mail question- 
naire returns, the responses to the same questionnaire from 
another random sample of 4,942 teachers were analyzed. In 

8 One of the disadvantages of mail investigations is the time it takes 
for returns to come in. In commercial studies mail is accepted usually 
for three weeks and then tabulation is begun. By that time approximately 
90 per cent of the total possible returns are received. In this particular 
study the last form was received 122 days after the original mailing. 
When one considers the necessary wait which is a part of mail surveys— 
and the cost per return in addition to all the other shortcomings—the 
advantages of the personal-interview technique far outweigh whatever 
advantages might be cited for the mail procedure. 





ee 
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TABLE IV 
Use of Classroom Radio Facilities by First 50 Per Cent and 
Last 50 Per Cent of the Total Respondents 
Teachers 
with class- 
room radio Diff 


Number facilities — 
Portion of sample of cases Total ‘‘have used’’ Diff. oDiff. oDiff. 








First 50 per cent... 1,580 574 432 75.3% 
Last 50 per cent... 1,579 575 430 74.8% °5% 2.55% 0.2 





Total oo nnnee 8,149 1,149 75.0% 





this case, however, a brief follow-up questionnaire was sent on 
the seventeenth day following the original mailing. The fol- 
low-up requested information only on the possession of class- 
room radio facilities in an effort to determine the percentage 
of ownership of those who did not reply to the longer, three- 
page form. The latter results will be discussed later. 

This second analysis, because of its two parts, presents two 
samples for examination by halves to discover the influences 
of ownership on the speed of return. Table V is an analysis 
similar to the one shown in Table I comparing the first and last 
halves of the respondents on the question of ownership of class- 
room radio facilities. These data are based on the returns to 
the full-length form. 

TABLE V 
Owneiship of Classroom Radio Facilities by First 50 Per Cent and Last 
50 Per cent of the Total Respondents to Long Form of Questionnaire 





Teachers with 
Portion of original classroom radio 
questionnaire § Number facilities Dia. 
sample ofcases No. Pet. Diff. oDiff. oDiff. 





First 50 per cent 701 227 39 82.4% 
Last 50 per cent 701 235 335% 11% 251% 44 





Total ..... 





1402 462 33.0% 





As in the case of Table I, there is no significant difference in 
the possession of classroom radio receivers between the early 
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and late respondents. This same condition prevails in Table 
VI where the comparison is between the first and last halves of 
the respondents to the briefer follow-up questionnaire. 


TABLE VI 
Ownership of Classroom Radio Facilities by First 50 Per Cent and Last 
50 Per cent of the Total Respondents to Follow-up Questionnaire 


Teachers with 
Portion of follow-up classroom radio ‘ 
questionnaire Number facilities Diff. 
sample of cases No. Pet. Diff. oDiff. oDiff. 








First 50 per cent 540 123 22.8% 
Last 50 per cent 540 124 248% %0% 259% 477 





257 23.8% 





The data presented thus far point convincingly to the fact 
that on two factors, ownership and use of classroom radio 
equipment, early returns of the questionnaire do not differ 
significantly from later returns. This result, if substantiated 
by further investigation, holds broad practical implications for 
mail studies which must be tabulated as early as possible, 
since analyses of early returns could be used without undue 
fear of special bias on certain factors resulting from early 
versus late returns. However, on the basis of results to come, 
the research worker who empleys the mail questionnaire as an 
instrument for obtaining voluntary information should be cer- 
tain those who do respond are representative of those who will 
not reply. 

Earlier, the follow-up technique was mentioned in connec- 
tion with the second sample of school teachers. The follow-up 
form was mailed on the seventeenth day at that point in the 
cumulative curve of responses to the original mailing where 
the curve began to level off significantly. This form, in con- 
trast to the original three-page questionnaire, was a double 
government post-card containing a single question on radio 
facility ownership which required a single check mark in an- 
swering. Brevity was intentional to insure the largest possible 
return. 








: 
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It is interesting to note in passing that whereas 28.3 per 
cent of the first sample of teachers replied to the original 
questionnaire, 50.2 per cent* of the second sample responded to 
either the original form or the follow-up—an increase of better 
than 75 per cent.° 

However, turning to a comparison based on classroom radio 
ownership by teachers responding to the original questionnaire 
and those replying to the follow-up form, one of the real dan- 
gers of the mail-questionnaire technique comes to light. This 
is the difference in ownership between the two groups of 
respondents; it is shown in Table VII. 

The difference of 9.2 per cent in the percentage of teachers 
having classroom radio receivers in these two groups of re- 
spondents, as shown in Table VII, is quite marked. The size 
of this difference and the fact that the critical ratio indicates a 
true difference suggests interesting lines of speculation and cau- 
tion to persons contemplating mail surveys. 

On the basis of the data presented, the generalization can be 
made that teachers without classroom radio facilities were 
more reluctant to reply, and required the stimulus of a fol- 
low-up before responding. Why the non-owning group was 
slow to return the questionnaires is open to speculation and 
deserves further investigation to determine the real reasons in- 

* While returns to the majority of mail surveys range from 5 to 20 per 
cent of the total sample, it is possible to insure greater responsiveness by 
pretesting the questionnaire and by using follow-ups. The writer 
recently obtained » 94 per cent return to a nine-page discussion and ques- 
tionnaire. Three full-length follow-ups were employed: one when 54 per 
cent of the replies had been received, the second when 72 per cent, and the 
third when 89 per cent had been returned. 

5 It is significant in this connection that even though the follow-up pro- 
cedure increased the total response, the process did not lengthen the period 
between the date of the first mailing and the receipt of the last question- 
naire. In the first study reported, where no follow-up was used, the last 
questionnaire was received on the 122nd day; whereas in the second study, 
with a follow-up on the 17th day, the final questionnaire was received on 


the 117th day. In both studies approximately 95 per cent of the ques- 
tionnaires received were returned within 30 days. 
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TABLE VII 
Ownership of Classroom Radio Facilities by Respondents 
to Original Questionnaire and Follow-up Form 








Teachers with 
classroom radio iff 
Number facilities Dif. 
Group of cases No. Pet. Diff. so Diff. o Diff. 
Teachers who an- 
swered original 


questionnaire ... 1,402 462 33.0% 





92% 1.84% 5.00 
Teachers who an- 

swered follow-up 

questionnaire .... 1,080 257 23.8% 





SID iicriesLsbidioiene 2,482 719 ~ 29.0% 





volved. Possibly non-owning teachers felt less interested in the 
subject than those having experience with classroom radio listen- 
ing, the latter being sufficiently interested in the movement 
to assist in any way possible. Of course, ownership of class- 
room radio receivers suggests progressiveness on the part of 
the school or teacher and hence the same factor which was re- 
sponsible for getting the equipment into the classroom might 
account for the cooperation on the survey. Perhaps, too, non- 
owning teachers believed negative responses were not essential 
to the survey, despite explicit instructions to the contrary. Or 
again, there is the possibility of not wanting to admit non- 
ownership because it signified an inferior financial position.® 

Whatever the cause for the difference, the findings confirm 
the contentions of research workers who generally distrust mail 
surveys because there is no assurance that those who do reply 
are representative of the ones never heard from. While proof 
is lacking at this time, it is reasonable to assume an even lower 
percentage of ownership among the remainder of the sample 
from whom no replies were ever received. 

6 This situation would probably occur more frequently in cases where 


negative responses to the subject of the questionnaire would imply a more 
decided social stigma. 
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In summary, the analyses reported reveal: (1) there were no 
significant differences between the first and last parts of the 
respondents to the original three-page questionnaire, in terms 
of ownership or use of classroom radio facilities; (2) the re- 
sults of a follow-up are at variance with findings based on 
replies to the original mailing, suggesting that the usual re- 
sponding portion of a mail survey sample is not representative 
of the non-returning group; (3) the use of the follow-up tech- 
nique produces a noticeable increase in returns and decreases 
the possibilities of bias. 


ARTICULATE AND INARTICULATE REPLIES 
TO QUESTIONNAIRES* 


ISABELLE F. WAGNER 
Princeton Radio Research Project 


F a question requires more than the answer ‘‘yes—no,’’ or 
the checking of a list of alternative answers, the analyst is 
startled by the differences in the respondent’s ‘‘articulate- 

ness.’’ On a question which requires free comments, some 
people answer effusively and others very little or not at all. If 
the question asks, for instance, for criticisms of a radio pro- 
gram or general comments on what listening means to the re- 
spondent, we can never expect more than a minority to give 
really useful information. 

Is it then admissible to take the statements of the articu- 
late minority as representative of the whole group? Are those 
who do not offer comments, basically very different from those 

1 The Princeton Radio Research Project wishes to thank the editors of 
the Woman’s Home Companion for permitting the analysis of their data. 
The writer of this report is indebted to Miss Marjorie Fiske for her initial 
treatment of the data; to Dr. Max Herzberg and Dr. William Lewin of 
Weequahic High School, Newark, New Jersey, for their cooperation in 
providing subjects for the high-school study; to the National Youth Ad- 
ministration for their clerical assistance in this study; and especially to 
station WOR for its generous cooperation. 
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who are articulate, or do all of them have similar attitudes, 
with the possible difference that one speaks out and the other 
does not? In the following paper, an effort has been made to 
obtain information on this point in an indirect way. We do 
not know what people think about the points concerning which 
they do not write. However, in many questionnaires there 
are questions that require a check mark or one or two words 
of information. For those questions we usually have the 
answers of all respondents, whether or not they reply to the free- 
answer type of question. The approach used in this paper is to 
classify respondents according to the elaborateness of the com- 
ments they make on the free-answer type of question, and in 
this way to get groups of varying articulateness. These 
groups can then be analyzed on the points for which we have 
supplementary information from the simpler kind of ques- 
tion. For example, we want to know whether the more articu- 
late people are older, have higher incomes, or have different 
hobbies as compared with the less articulate. 

The data used in the present study were the answers given 
by 588 women to two different questions in a Woman’s Home 
Companion survey. One question, called ‘‘ Looking at Your- 
self,’’ was: ‘‘If time and money were no object, and you could 
do exactly what you liked, what hobby (or hobbies) would you 
take up?’’ The other question, called ‘‘The World at Large,’’ 
was: ‘‘Tell us what you think of the ‘state of the Nation.’ 
. . . Will you jot down here any opinions you have about the 
world at large?’’ Eight lines of free space were allowed for 
the first question, and twenty for the second. Each question 
appeared in a different questionnaire. 

As a check on the results of the above study, we made a 
similar analysis of answers given by high-school students to 
two free-answer questions. While there were too few cases to 
permit broad generalizations, some interesting trends were 
noted. These results may be found in the appendix. 

2 This study is but a by-product of other studies furnishing material 


pertinent to our problem. No investigation was specially mapped out to 
secure the necessary data. 
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The measure of ‘‘articulateness’’ was the total number of 
words used in each reply, since it was found far too difficult 
to make an objective analysis in terms of the clarity, fluency, 
or logical consistency of each answer. Therefore from now on 
the word ‘‘articulateness’’ will be used as if synonymous with 
‘‘verbosity,’’ even while we recognize that some investigators 
may question the assumption. 

Tho welbquenpe-enebslGebalatig wets cs danited, bo 
yond the fixed zero group, as to have frequencies arranged 
approximately in a ‘‘n ”? distribution of 20, 30, 30 and 20 
per cent. That is, for the four ‘‘ World-at-Large’’ word-groups 
following the zero groups (1-100, 101-144, 145-200, 201 and 
over), 20 per cent of the total cases for these groups would 
fall in the 1-100 group, 30 per cent in the 101-144 group, 30 
per cent in the 145-200 group, and 20 per cent in the 201-and- 
over group. 

The method of analysis can be illustrated by the following 
table : 





TABLE 1 
Articulateness vs. Size of Community in Women’s Survey 
Second question: 
The World at Large 
No. words City Large town Smalltown Total 





ic F fo ff el a 





0 52 (51) 27 (34) 61 (54) 140 
1-100... 33 (34) 23 (23) 87 (36) 93 
101-144... 44 (49) 39 (33) 51 (52) 134 
145-200 .......... 50 (49) 32 (33) 51 (51) 132 
201-up ..... 37 (83) 2 (22) 28 (84) 89 
Total 216 145 227 588 








fo= observed frequency. f= chance frequency. 


The Chi-square method of ascertaining the significance of 
the table was used.* The observed frequencies (f,) were first 


8 F. C. Mills, Statistical Methods Applied to Economics and Business, 
1924, 626-630. 
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tabulated. Beside them, in parentheses, are the chance values 
(f) computed in the following manner. The chance frequency 
corresponding to a given observed value was obtained by divid- 
ing the total of the vertical column in which the value ap- 
peared by the grand total (588) and then multiplying by the 
total of the horizontal column in which the value appeared. 
For each number we found the value of the formula: 
(fo-f)? 
f 

For example, for city vs. word-group 101-144 the chance value 
is 

_ 216 x 134 

i= 588 

The sum of all these values (or Chi-square) in Table 1 is 
6,338 ; by referring to a Chi-square table‘ we find this indicates 
a probability of .60, 1.¢., six times out of ten we could expect to 
obtain the same observed values through mere chance. But 
only a probability of .05 or less gives a table significance. 
Therefore we can say in the case of Table 1 that women in a 
small community are neither more nor less articulate than those 
residing in a larger community. 


= 49.2 


TABLE 2 
Comparison of Articulateness in Women’s Replies to Two Questions 


The World at Large 
words 0 1-100 101-144 145-200 201—up Total 








014 (8) 6 (5) 8 (7) 4 (7) 1 (5) 383 
1-24 41 (27) 27 (18) 21 (26) 22 (23) 8 (17) 114 
25-51 43 (41) 35 (28) 40 (39) 33 (39) 22 (25) 173 
52-77 27 (40) 14 (27) 49 (38) 49 (38) 29 (25) 168 
78up 15 (24) 12 (16) 16 (23) 25 (23) 82 (15) 100 

3 Total 140 94 134 133 87 588 


i Re: ea ER SoBe he cb Be he 8 
m 
a 





fo= observed frequency. f= chance frequency. 
« Ibid., Appendix. 
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The results can best be discussed in relation to certain 
theoretical questions. 

1. Is there such a trait as articulateness? If such a trait 
exists, we should expect to find a correlation between the word- 
counts of two different replies given by a single subject. 

Table 2, with a probability of .00. . . . indicates that such a 
relationship actually exists for the women of the Woman’s 
Home Companion survey.’ The coefficient of contingency 


Noty computed for this table shows a value of +.34. 


Thus there is a tendency for the women to show a similar 
degree of articulateness in their two replies.® 

2. Is articulateness a function of certain primary charac- 
teristics of an individual? For various factors in the women’s 
survey the probability scores are indicated in Table 3. 














TABLE 3 
Probability Scores of Various Factors in Relation to Articulateness 
First question : ot. poy em 
Looking at Yourself The World at Large 
Age 90 -70 
Income level 90 45 
Size of community 35 -60 
Marital status 
Number of children ................... 65 55 
Single vs. married .nn« 50 .20 
Occupation of husband ................. 98 45 





With this last factor, there was a slight tendency for the wives 
of farmers to be less articulate than chance would indicate. 
In general, however, we must conclude that articulateness is 

5 It is interesting to note that the women more frequently failed to re- 
spond to the question about world affairs (24 per cent did not answer) 
than to the question about their own interests (only 6 per cent did not 
answer). 

7 ical, 1h eas en sti Miieeth eaaiinesih iamiadaaiesias 
two different questions, as we have done in the case of articnlativeness. 
Such an analysis is relatively simple, and should be used more frequently. 
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not related to such factors as age, income level, size of com- 
munity, marital status, or occupation of husband.’ 

3. The third and most important consideration is this: 
Have articulate people habits and interests which differ frcm 
those of inarticulate people? This is the main question in our 
study. 

We have this additional information concerning the women : 


a. Reliance on advertising via radio, newspapers, dealers 
and magazines.*® 

b. Number of movies attended per month. 

ce. Leisure-time activities. 

d. Favorite radio programs, daytime and evening. 
The probability scores for the first two factors are given in 
Table 4. 

TABLE 4 

Probability Scores of Certain Factors in Relation to Articulateness 





First question : Second question : 
Looking at Yourself The World at Large 





Reliance on advertising via: 














Radio 80 10 
Newspapers 94 30 
Dealers .88 88 
Magazines 95 97 
No. movies attended ....................... “ .20 .20 





7 Some interesting speculations may be made concerning the results in 
Table 3. Income level and occupation of husband have a slightly greater 
effect upon the articulateness of answers to the question about world 
affairs than to one about personal hobbies. One would expect a similar 
effect if education and articulateness were considered. Unfortunately, 
however, the important factor of ‘‘amount of education’’ was not in- 
cluded in this survey. If income level could be taken as an approximate 
index of this factor, we might say that education bears little relationship 
to articulateness except to a slight extent when a question on world affairs 
is involved. 

8 A separate question was used for each item. Although the wording 
varied, the questions asked whether advertising through each medium was 
used as a shopping and marketing guide. 
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Here there are no significant scores; that is, articulate and in- 
articulate women cannot be differentiated in terms of movie 
attendance or their reliance on different advertizing media. 
Leisure-time activities were first classed as indoor (largely 
individual),® outdoor, social, and creative. Grouped thus, 
neither question showed significant differences. However, 
when the more specific categories of active sports, reading, and 
needlework were isolated by separate tabulation, the latter two 
did show significant differences. The less articulate women 


TABLE 5 


Articulateness vs. Certain Leisure-Time Activities 
Per cent of Total Activities Cited 











First question : Second a 
Looking at Yourself The World at Large 
Total Total 
No. Read- Needle- activ- No. Read- Needle- activ- 
words ing work ities words ing work ities 
cited cited 
Dds FF 11.5 26 oe 16.4 153 
1-51 .. 17.1 17.1 333 1-144 ... §=6 21.5 12.7 288 
52up... 24.2 9.9 302 145 up ... 23.2 10.4 250 
Total... 20.0 13.6 661 Total ..... 20.1 12.7 691 








tended to read less and do more needlework than chance values 
would indicate, while the more articulate women read more 
and did less needlework. 

Program preference likewise showed significant differences 
only for specific items. Daytime programs were classed as 
drama, news, women’s programs, popular music, classical 
music, variety, educational and semi-educational, and miscel- 
laneous. Evening programs were grouped the same, save that 
the women’s-program category was omitted. The daytime 
drama specified by all the women was largely serial, while 
evening drama was only about a third serial. Nevertheless, 


® Indoor: needlework or sewing, collecting, reading, cooking, puzzles 
or contests, music (if not creative). Outdoor: horseback riding, swim- 


ming, motoring, picnics, walking, nature study, fishing, camping, etc. 
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for both daytime and evening programs, the less articulate 
women preferred drama somewhat more than chance would 
indicate, and the more articulate women, less. For example, 
Table 6 shows the trends for daytime programs. 


TABLE 6 


Articulateness vs. Specific Daytime Program Preferences in 
Women’s Survey 


Per cent of Total Preferences Cited 














(a) 
First question: 
Looking at Yourself 
Total 
No. words Drama Classical preferences 
music ; 

cited 
_ ees eres 48.7 2.7 37 
BR ceases om 37.2 8.3 374 
52 up ......... 32.9 16.2 425 
aR a 35.5 12.1 836 

(b) 


Second question: 
The World at Large 





DP sntncisttnesiinds is 33.7 7.9 190 
1-14 ............. i 33.2 9.6 323 
145 up ........... in 28.6 14.9 322 
Seren - 31.4 11.2 835 





Exactly the reverse was true for classical music; here the dif- 
ference was even more pronounced for both daytime and eve- 
ning programs. Popular music, which at first included swing, 
hill-billy, cowboy, religious, old-time, band, and semi-classical 
music, showed no such difference. Even when regrouped as 
conservative (hill-billy, cowboy, religious, old-time), orchestral 
(band and swing), semi-classical, and ‘‘music’’ (where only 
the general term was used), no significant trends could be 
discovered. 
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There is some indication, then, that the more articulate 
women have interests and activities of a slightly higher cul- 
tural level than is true for the less articulate women. 

What, then, can we conclude about articulateness in relation 
to our problem of adequate sampling? There are three theo- 
retical possibilities : 

1. Articulateness may be a function of personality. Per- 
haps the more articulate person has more friends, is more in- 
terested in public affairs, or spends more time at social gather- 
ings than does the inarticulate person. If this were true, 
responses to the free-answer type of question would be weighted 
in terms of a personality type. 

2. Articulateness may be a function of intellectual train- 
ing. It may be a complex product of intelligence, education, 
past experience, and present occupation, and hence related to 
such factors as general knowledge or program preferences. 
If this were true, responses to the free-answer type of question 
would be weighted in terms of individuals with a more favor- 
able cultural background. 

3. Articulateness as a general characteristic may not exist. 
Hence it should show only a chance relationship to the factors 
cited in (1) and (2). If this were true, we could assume that 
the more articulate responses to the free-answer type of ques- 
tion could be taken as representative of the entire group of 
respondents. 

Our own material bears out the second possibility, that ar- 
ticulateness is to some extent a function of intellectual train- 
ing. We may summarize the pertinent findings regarding the 
588 women in this study as follows: 

a. The correlation in articulateness between the two replies 
given by women indicates that articulateness in itself 
may be a trait or persistent tendency. 

b. Articulateness is not a function of primary character- 
istics such as age, income level, size of community, 
marital status, or occupation of husband. 

e. More articulate people differ from inarticulate people 
in certain habits and interests, and this itself may be 
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the result of differences in intellectual training. Less 
articulate women prefer needlework and dramatic pro- 
grams, especially serials, while more articulate women 
prefer reading and classical music. They do not dif- 
fer, however, regarding movie attendance or reliance 
on advertizing via radio, newspapers, dealers, or 
magazines. 
APPENDIX 


The data of this supplementary study were answers given 
to two questions, on different questionnaires, by 551 high- 
school students of Newark, New Jersey, who were panel listen- 
ers‘ to a series of radio programs. The questions were: 


a. What did you particularly like about this broadcast 
(a dramatic program) ? 

b. Have you ever learned anything from the radio? If 
yes, what is it? 


Three lines were allowed for the first question, and two for the 
second. There were 287 and 501 cases for the two questions 


respectively.2 The measure of articulateness was again the 
total word-count. 

While in the case of the women there was a correlation in 
articulateness between the two replies, this did not hold true for 
the present data. The probability score was .63, which means 
that in 63 cases out of 100 these results could be duplicated by 
mere chance. 

Hence these data did not support the concept of articulateness 
as atrait. It is possible that traits, or persistent tendencies to 
act in a certain way, are not yet well established in the unstable 
adolescent, and only gradually take shape as he matures. 

Articulateness in this study, as measured by the total word- 
count, was compared with such primary characteristics as age, 

1See P. F. Lazarsféld and M. Fiske, ‘‘The Panel as a New Tool for 
Measuring Public Opinion,’’ Public Opinion Quarterly, 2, 1938. 

2 The totals here are different because in a number of cases a student 


for some reason or other did not hear both programs or was absent when 
one of the questionnaires was given. 
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class in school, grades, IQ (from a variety of tests), and per- 
sonality score (from Willoughby revision of Bernreuter, short 
form). No relationship was apparent; the probability values 
obtained were similar to those listed for the other study. 
Within the narrow limits of this group of subjects, one would 
not expect age or class in school to be significant. The some- 
what arbitrary nature of grades would perhaps account for their 
lack of relation to articulateness. But one may be surprised to 
find that IQ is not a significant factor. The fact that the IQ’s 
here were derived from a great variety of tests, with test condi- 
tions unspecified, may affect the comparability of the scores. 
Nevertheless, if we compare the median word-counts for each 
question, as shown in Table 2, we note that although the differ- 
ences are not significantly great, the least intelligent students 
were most articulate in describing what they liked ebout some- 
thing and least articulate in describing what they learned from 
something.*® 








TABLE 1 
Articulateness vs. IQ in High-School Survey 
Median Word-Count 

IQ Question on likes § Question on learning 
Below 100 0... 9.5 5.0 
SIT diicncrnithneininits 76 5.6 
ng | ERT B ER Ose 8.5 54 
PE inintenecnesetennsiitionn 8.9 6.2 





All the students, regardless of IQ, tended to give longer replies 
to the questions on likes than on learning, perhaps in part be- 
cause more space was allowed, but the difference was greatest for 
the group with the lowest intelligence. Such findings point to 
the need for more systematic studies of this kind. 

Again, the personality score may not be constant in view of 
the emotional instability of most adolescents. 


8 The average number of cases in each group for the first question was 
about 65; for the second, about 100. 
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In the case of these high-school students we were able to study 
one factor, sex, which was not involved in the study of women 
readers. Here there was a significant difference (probability 
.00 . . .), though only for the second question, concerning what 
was learned from radio. 








TABLE 2 
Artioulateness vs. Sex in High-School Survey 
Second Question 
No. words Boys Girls Total 
fo f fo f 
© sdb 44 (54.7) 88 (77.38) 132 
8 sctiense 35 (27.4) 31 (38.6) 66 
a . 51 (39.5) 44 (55.5) 95 
EE, cwibiitigetes 52 (49.8) 68 (70.2) 120 
eS 26 (36.6) 62 (51.4) 88 
. i. 208 293 501 





fo=observed frequency. f=chance frequency. 


Table 2 indicates that girls are somewhat more likely than boys 
to give short answers to this question; they are more likely to 
give either very long answers or no answers at all. The theo- 
retical interpretation of this fact. is not apparent. 

In general, the trends with respect to drama and classical 
music were similar to those preference trends for adult women. 
However, when the high-school data were broken down in terms 
of sex, the figures became so small that all the evidence was 
inconclusive. 


THE FAVORITE RADIO PROGRAM 
HAZEL GAUDET 
Princeton Radio Research Project 
THE PROBLEM 

BVIOUSLY the student of radio listening will frequently 
want to ascertain the program preferences of different 
groups of people. There are two principal purposes in 
radio research which are served by collecting this information. 
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One is to study types of radio listeners, and for this purpose 
it is desirable to require a considerable number of programs 
from each subject to secure sufficient information about the 
individual to form a judgment as to his radio listening habits. 
For more general purposes of testing the popularity of the dif- 
ferent programs themselves, however, a smaller number of pro- 
grams might be sufficient, since it is of practical importance for 
listener research to keep the amount of questioning to a min- 
imum. This paper aims to ascertain the minimum number of 
programs which an interviewee can be requested to mention in 
order to reach a valid determination of the popularity of dif- 
ferent programs in the particular group of people to which the 
subject belongs. The theoretical implications of the problem 
came to the fore only as the problem developed, so finally, evi- 
dence was drawn on from different sources. 


THE FIRST PROBLEM 
The best point of departure seems to lie in a study made with 
462 high school students who, in the frame of a more general 
study, had been asked the following question :* 


What are your five favorite radio programs of any sort to which you 
listen frequently? 

(a) 
(b) 
(¢) 
(a) 
(e) 


They were thus not asked specifically to rank the programs in 
the order of preference. 


1 Acknowledgment is made to Dr. Max Herzberg and Dr. William 
Lewin of Weequahie High School, Newark, New Jersey, for their interest 
and cooperation in providing the subjects for this study. Acknowledge- 
ment is also due the National Youth Administration of Essex County, 
New Jersey, for assistance in the preparation of the questionnaires and 
the clerical help used in the analysis of the results. We are especially 
indebted to station WOR for its generous cooperation. The complete study 
will be published as a part of a monograph of the Princeton Radio 
Project. : 
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All of the first programs mentioned were tabulated, then the 
first two, the first three, and so on until finally all five were con- 


sidered.? Table 1 shows the results that were obtained when 

the fifteen programs most frequently mentioned by these high 

school students were examined for the per cent of times they are 
TABLE 1 


Per Cent of Times the Fifteen Leading Programs Are Mentioned when 
Different Numbers of Programs Are Considered 





First First First First 





All fiv: 
Name of program pro- twe three ft “ng pro- ; 
pro- pro- pro 

gram = grams) «grams grams 8**™s 

Lux Radio Theater ...... - 20.2 15.5 12.7 11.1 10.4 
Eddie Camtor ccc 9.8 9.2 8.4 7.6 7.3 
Taek Benny ccccccccnnnm 8.0 9.5 7.8 7.3 71 
Charlie McCarthy ............. 5.8 7.1 6.4 6.0 6.3 
Gang Busters ccc 8.0 7.9 6.9 6.2 5.8 
kk " 4.2 4.4 4.5 4.3 4.0 
Hollywood Hotel. ............ 1.8 2.4 2.9 2.7 2.9 
March of Time .................. 2.4 2.3 2.9 2.6 2.7 
Hit Parade .................. ioe 0.9 1.7 2.1 2.1 2.5 
Cavaleade of America .. 2.0 2.2 18 2.0 2.2 
Major Bowes ...................... 0.7 1.5 1.6 18 2.1 
Good News of 1938 ........ 1.6 19 1.8 2.0 2.1 
Benny Goodman ............. 2.2 2.2 1.9 1.8 2.0 
Second Husband .............. is 2.0 2.1 2.1 1.8 1.7 
EO BN tien “! 2.0 1.8 14 1.4 1.6 

Number of mentions ..... 450 905 1366 1820 2262 





mentioned when the different numbers of programs are tabu- 
lated for each subject. The programs are arranged in the order 
of the greatest frequency when all five programs are tabulated 
for each individual. 

The five columns show that from the beginning there is con- 
siderable stability in the rank order of the programs, the coeffi- 

2 Although certain criticisms can justly be levied against this tech- 
nique, such weakness was overlooked in the interests of practicality since 


the data treated in this study are only a small part of material collected 
for larger studies. 











: 
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cient of rank order correlation between the first and fifth column 
being .72. After the third program, the rank order and also the 
frequency remain fairly constant, the relation between the third 
and fifth columns being .94, while that between the first and 
third columns is .84. 

It seems then that in this case it would have been sufficient to 
ask for three programs from each individual since the addition 
of two more programs had imperceptible results. 

The problem has an interesting statistical side which deserves 
mention. On rather general assumptions one can state that the 
frequency with which a program is mentioned by a group is pro- 
portional to the average intensity of liking as measured by some 
appropriate yardstick. The frequency of mentions, therefore, 
ean be called a measure of general popularity. In this sense we 
can see from Table 1 that Jack Benny has the same general 
popularity as the Gang Busters program in the first column. 
If, however, we compare the trend of the figures in the five 
columns for these two programs, we find that the latter is more 
likely to be mentioned first than it is in other positions, whereas 
Jack Benny does not vary quite as widely from the first to the 
fifth column. This trend in the five figures given for each pro- 
gram can, therefore, be considered a measure of comparative 
appeal: it shows whether a program is generally mentioned in 
association with programs of similar general popularity or 
whether it is outstanding in a positive or negative direction. 
Analysis of the problems of probability involved in this kind 
of result, shows that programs of very great popularity are also 
likely to have at the same time, a high comparative appeal as 
shown in the first five programs of Table 1. In general, how- 
ever, the two measures can vary independently. A program of 
serious music, for instance, could have a low general popularity 
appeal and still be mentioned first whenever it is mentioned at 
all. More exact discussion of this problem will be given else- 
where.* 

8 The Princeton Radio Research Project will publish a special mono- 
graph on advanced statistical methods in listener research. 
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ATTEMPTING A PSYCHOLOGICAL ELABORATION 


If it should prove generally true that the mentioning of more 
than three programs does not change the frequency distribution 
of the general popularity of a program appreciably, the ques- 
tion still remains whether it is necessary to ask for as many 
as three programs from each subject. The problem then is 
whether the first or the third column of Table 1 represents a 
more ‘‘psychologically sound’’ measure of popularity. It can 
be stated more clearly by the following reasoning: The fre- 
quency with which a program is mentioned is proportional to 
the average intensity with which the group likes it. If the first 
mentioning of a program represents a much higher degree of 
liking than the second or third mentioning, then it would be 
better to consider only the first column of Table 1. That 
would amount to giving a weight of zero to all the mentions but 
the first. If, on the other hand, the intensity with which pro- 
grams are liked does not vary significantly between first, second, 
and third mentioning, the best approximation would be reached 
by using the third column of Table 1 as the best measurement, 
which amounts to giving the first three mentions equal weight. 

In order to decide this question, an experiment was devised 
on a different group of subjects, namely 158 Princeton psy- 
chology students.* This group was given a two-page question- 
naire, on the first page of which they were asked the same ques- 
tion as the previous sample, ‘‘ What are your five favorite radio 
programs of any sort to which you listen frequently?’’ On the 
second page they were given five graphic rating scales ranging 
from — 10 to + 10 with zero indicating an average score, on which 
to rate the five programs which they had just listed according 
to the degree liked. Thus it was possible to compare the ratings 
given to the programs with the order in which they had been 
mentioned when the subjects had not been specifically asked to 
rank them in the order of preference.® 

4 Acknowledgment is due Dr. Hadley Cantril for his cooperation in 
securing these subjects and administering the questionnaires. 

5 The purpose of this experiment was two-fold: first, it was hoped to 
ascertain the average rating of the five steps when the program choices 
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The instructions were as follows: 


**In order to aid you in expressing your opinion more clearly, you will 
find below a scale which will.enable you to check your degree of liking 
from +10, meaning ‘exceptionally good’; to -10, meaning ‘very poor,’ 
with zero representing an average amount of like or dislike. 

‘*Referring to each program named above, would you please place a 
check on the scale at the point you feel represents your degree of liking 
for the program? Please keep the same order: scale ‘a’ corresponds to 
program ‘a’,’’ 

Very Exception- 
ot: ieee ri 
=10 =5 0 +5 +10 


The reader will see that in the paper on ‘‘ Judging the Merits 
of Popular Songs’’ (p. 19) the rating scale used a range from 
0to10. In the present case the scale ranged from — 10 to + 10 











TABLE 2 
Average Rating Given to Five Favorite Radio Programs in Order 
of Listening 
Average Standard 
rating deviation 
TD cncnigfiatteninis 6.8 2.3 
| 5.9 2.4 
All programs mentioned: third 4.6 2.7 
fourth ........ 4.5 2.8 
ee 44 3.0 





because it was considered of greater psychological significance 
to have judgments center around a neutral point. 

The results of this second experiment seem quite conclusive. 
Table 2 shows the average rating assigned by these students to 
the programs on each line of the list. The figures show that 


were made under the same instructions as represented at the beginning 
of this paper, and secondly, as a by-product, it was hoped to learn to 
what extent people give their programs in the order of preference when 
not specifically requested to rank them. 
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although the programs decrease progressively in average rank 
from first to fifth position, the differences are so small and the 
variability so great that the first program should be weighted 
much more than any of the others. It, therefore, seems much 
more af-propriate to consider the first three programs mentioned 
than to take the first choice only. 

This result would be quite satisfactory if there were not an- 
other fact which requires further analysis. When the order in 
which programs are given in the first step of the Princeton ex- 
periment is compared with the order in which they fall when 
they are ranked according to the rating given in the second step, 
the rank order coefficient of correlation is only .25. There seems 
to be something in the whole experimental set-up which made 
those ratings in the second step not quite descriptive of the pro- 
cedure followed by the subjects in the first step of the experi- 
ment. 

The following example from the response of one Princeton 
student will make the matter clear. He listed his five favorite 
programs on the first sheet as follows: (a) Jack Benny, (b) 
Bob Burns, (c) Hit Parade, (d) Philharmonic Symphony, (e) 
Charlie McCarthy. His quantitative rating of these programs 
on the graphic rating scale, however was the following: Jack 
Benny, 5; Bob Burns, 0; Hit Parade, 2; Philharmonic Sym- 
phony, 8; Charlie McCarthy, 1. The order of his preference 
according to his rating scores, then, would be: Philharmonic 
Symphony ; Jack Benny; Hit Parade; Charlie McCarthy ; Bob 
Burns. This is quite different from the first order. 

Table 3 gives the statistical result of this grouping for all the 
students. The first column lists the programs which ranked 
highest in frequency of mention when a mere listing of pro- 
grams was requested, the second column the five which were 
ranked at the top when they were given deliberate quantitative 
ratings. 

It is quite striking to note the difference in the cultural level 
of the two lists. The first list contains chiefly those successful 
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comedians and band leaders whose names are usually at the 
top of such lists of program preferences. The second list con- 
tains those cultural programs which a student might feel 
obliged to say he likes when he considers the matter more care- 
fully. It, therefore, seems very probable that the deliberate 
rating of the programs changed the attitude of the student from 
a natural reaction to a self-conscious and socially-determined 
decision. The shift in content of the leading programs make it 











TABLE 3 
Comparison cf Results of Mere Listing and Deliberate Rating 
Mere listing Deliberate rating 
Name Frequency Name Frequency 
Jack Benny | :17.1 New York Philharmonic 14.2 
Charlie McCarthy ........._ 12.7 Information, Please! .... 13.5 
Benny Goodman ............ . 12.0 IE siceesssintitaniemnie 9.2 
New York Philharmonic 11.4 fe . 78 
Robert Benchley ............. 7.6 Fak Benny -cccccccceccne Lit 78 





quite doubtful then, that the ratings in the second part of the 
experiment can really be used as indices for the weight of the 
steps assigned to the programs in the first part. 

As a result the Princeton experiment cannot be taken as evi- 
dence for the contention that the second and third programs 
mentioned on a list are about equivalent in importance to the 
first one. We could not think of any other way to test this 
question without getting into the same difficulty which our 
experiment revealed. Therefore, we must rely on general rea- 
soning based on such inferential evidence as is available. 

In two instances, students have offered evidence that the first 
item on a list is actually of much greater weight than the rest of 
the items mentioned. The first is cited by Thomas and Young,*° 
who asked college students to list the initials of people they liked 
and disliked without any instructions as to rank order. After 


¢N. F. Thomas and P. T. Young, ‘‘Liking and Disliking Persons,’’ 
Journal of Social Psychology, May, 1938, 9, pp. 169-188. 
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this was done, the subjects were asked to rank these people 
according to the intensity of liking and disliking. The authors 
found that if all the names mentioned were considered, men 
were more likely to mention men, and women more likely to 
mention women as best liked people. If, however, only the first 
choices were considered, each was more likely to mention the 
opposite sex at the top of their free lists. In the light of 
our interpretation this indicates that in listing people there 
is a different significance in the first place on a free list 
than in any of the following steps. It is not difficult to guess 
that the difference corresponds to the fact that in general we 
like several people but we love just one. 

The other case on hand comes from experiences in the field of 
market research where people are often asked to list the favorite 
names of brands of merchandise. Hotchkiss and Franken argue 
strongly that perhaps the first associations are the most reliable." 
They claim that some eminent psychologists estimate that a first 
association averages at least twice as strong as a second asso- 
ciation, and that subjects usually put down the first name or two 
almost immediately, then rack their brains a little before recall- 
ing additional names. Here again, the first brand-name men- 
tioned might correspond to the one brand actually used, whereas 
the rest of the list might be names which are just remembered 
from hearsay or advertising. 

In those cases, then, where the preponderance of the first asso- 
ciation is claimed, there is an essential difference between one 
item and all the others which can be mentioned in a list. There 
seems to be no parallel to this psychological situation in the 
preference for radio programs. Many programs are available 
and hardly ever is there a program on the air which is the only 
one of its type. Conversely, then, this might be taken as nega- 
tive evidence which lends support to the earlier conclusion ; 
namely, that the first-mentioned radio programs do not differ 
appreciably in their psychological significance from the second 

* George B. Hotchkiss and Richard B. Franken, The Measurement of 
Advertising Effects, New York: Harper, 1927, pp. 38-40. 
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or third, therefore, the first three choices should be considered 
in studies of radio program preferences.® 


Three miscellaneous remarks should be added to this general 
conclusion. One pertains to the practical importance of the 
whole problem. It might be that when it comes to actually 
describing differences in the program preferences of two groups, 
it does not make so much difference how many preferred pro- 


TABLE 5 


Comparison of the Frequency of Mention of the Most Popular Programs 
for Males and Females Separately 

















First program All five programs 
Name of program . Sd 
Males Females Males Females 
Lux Radio Theater ............. . 16.5 23.2 8.6 11.9 
Eddie Cantor 2... 9.0 10.4 6.1 8.2 
Jack Benny... 9.0 7.2 7.6 6.9 
Charlie McCarthy .............. 8.5 3.6 6.6 6.1 
Gang Busters 0... 12.0 4.8 9.0 3.3 
Big Town 2.0 6.0 3.7 4.2 
Hollywood Hotel ................... 15 2.0 2.3 3.5 
March of Time ................... 4.5 0.8 3.8 18 
Hit Parade 0.0 1.6 16 3.3 
Cavaleade of America ....... 2.5 1.6 2.8 18 
Number of mentions .........._ 200 250 1008 1254 





grams the respondents are asked to list, In Table 5 program 
preferences of the boys and girls in the Newark study are 
8 This problem has been delineated by Baker in a study on radio listen- 
ing. He answers the question for his own data, however, only by casual 
observation and concludes that a tabulation of the first program men- 
tioned would not have produced results that correlated satisfactorily with 
a tabulation of all the programs mentioned. (Kenneth H. Baker, ‘‘ Radio 
Listening and Economic Status,’’ Psychological Record, August, 1937, 
I, 9, p. 109.) 
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recorded separately, when the first program is tabulated and 
then when all five programs are taken into consideration. The 
differences which exist between boys and girls come out equally 
well whether we consider one program or all five programs.° 
There are just two changes of any importance. Charlie 
McCarthy is much more a boy’s program according to the first 
choice alone than according to all five choices. In the case of 
Big Town, the preference of girls is greater if the first index 
is used. There did not seem to be any special explanation for 
this discrepancy. 

The second remark pertains to a variation of the question 
which is probably more important than might appear at first 
glance, that is, the possibility of not prescribing the number of 
programs to be listed at all, but leaving the respondents free to 
list as many as they please. It is very probable that in this case 
we would not find the stabilization of the frequencies which 
was found in the first table of this report, since from another 
study it is known that there is a correlation between number 
of programs mentioned and general cultural level of the pro- 
grams.*° It seems that people who listed a great many pro- 
grams gave a smaller proportion of such programs which might 
be called cultural, such as good music, discussions and the like. 
The farther we go, therefore, in the number of programs tabu- 
lated, the more likely should we be to get a relative increase in 
the non-cultural type of program. No table can be presented 
here because before reliable changes can be expected, a very 
large number of cases would be necessary. If, therefore, the 
interest lies with the programs themselves and not with the 
general attitude toward radio which can be measured by the 
number of programs mentioned, it will probably be more advis- 
able to work with a fixed number of favorite programs. 

® This interchangeability of indices is discussed in another paper in 
this volume. 

10 See paper in this volume by Francis Oliry and Elias Smith, ‘‘An 
Index of ‘Radio-Mindedness’ and Its Application.’’ 
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As a third caution we wish to stress the fact that this whole 
report dealt with single programs. Other studies have con- 
fined themselves to a study of program types only. Without 
discussing the relative merits of the two approaches, it must be 
remembered that the results of the two kinds cf studies cannot 
be compared directly. For instance, there are many dramati- 
zations and stories on the air but relatively few variety pro- 
grams. As a result in the Newark study it was found that if 
single programs are combined into types, dramatic programs 
rank high because of the frequency with which different pro- 
grams are mentioned, whereas when types of programs were 
checked directly the group liked comedy and variety programs 
with greater intensity. 


CONCLUSIONS 


There seems to be such a close relation between the ranks of 
the various programs when one to five favorite radio programs 
are considered for each subject, that as far as sheer rank goes, 
the number asked makes little difference. The relationship, 
however, is much closer between the rank order of programs 
when three and five programs are tabulated, so for general pur- 
poses of ascertaining best liked radio programs, it is probably 
sufficient to ask only three programs from each individual. 

General considerations lead one to suppose that it is 
preferable to ask for three favorite programs instead of only 
one. A special experiment, however, which was devised to 
prove this point appeared to be inconclusive because if people 
just jot down their favorite programs, the rank order is very 
different from the one obtained if a special rating of the pro- 
gram is required. 

In general, then, it may be said that there is considerable evi- 
dence pointing to the fact that as many as five programs are not 
necessary, one program is not sufficient, so therefore, three pro- 
grams probably constitute an optimum number to require from 
any one subject. 
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THE RELIABILITY OF A REPORT ON 
LISTENING HABITS 


ALBERTA CURTIS 
Princeton Radio Research Project 


N December 1, 1938, 795 questionnaires were mailed to 
() one-half of the individuals who had requested the fall 

program schedule of Station WOI, of Iowa State Col- 
lege. The listeners had been offered free copies during the 
week of September 19 to 25, just before the regular schedule 
was resumed, the summer schedule having been somewhat cur- 
tailed. It was assumed that the group desiring the schedule 
represented an especially faithful core of the station’s audi- 
ence. The purpose of the questionnaire was to get a com- 
parative rating on the listening to all programs, the criticisms 
of the respondents and their suggestions for additional pro- 
grams, and personal information which would be useful in esti- 
mating the appeal of different types of programs for different 
groups, according to age, sex, educational background, and 
economic level. 

Forty-five regular programs were listed, with time and type 
clearly indicated. Respondents were asked to check each pro- 
gram, under the headings of regularly, sometimes, or almost 
never. Regularly and sometimes were defined in the instruc- 
tions as follows: ‘‘If you listen to a program at least one-third 
of the time that it is given, check regularly ; if you listen to it 
less than a third of the time that it is given, check sometimes ; 
if you practically never hear a program, check the last column.’’ 

By December 15, 425 or 53.5 per cent of the questionnaires 
had been returned. Double postcards were then sent to these 
prompt respondents with the accompanying statement: ‘‘Be- 
cause two important programs were omitted on some of the 
original questionnaires, we are asking for your cooperation 
again. Please check the programs according to the amount 
you listen, whether regularly, sometimes, or almost never. It 
is just as important that the postcards be checked and re- 
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turned if you do not listen to these programs as if you do.”’ 
As a matter of fact, only one of the programs, opera music 
played one period a week for the home-study of the rural 
women’s Farm Bureau groups, had been omitted, and the 
other, the National Farm and Home Hour, was repeated as a 
check on the reliability of the original answers. 

Three hundred thirteen or 73.7 per cent of the postcards had 
been returned by January 8. The answers for the repeated 
program, the National Farm and Home Hour, were then cross- 
tabulated against the original answers (Table 1). 

TABLE 1 
Agreement of First and Second Report on Regularity of Listening 


Follow-up card 
= =. Almost No Nore- Total 
lar. times never check turns 








Regu- 
larly... 94 a. - 35 163 

Some- 
First times . 14 a § 4238 e 40 130 

question Almost 

naire never. 2 16 26 = 14 58 
No check 5 25 19 2 23 74 
Total .. 115 133 61 a ie 225 





Seventy per cent of the respondents repeated their original 
answers, and two per cent completely reversed it. If only the 
260 cases which gave complete information both times are 
taken, we find the following shift in the total distribution of 
replies :* 

TABLE 2 
Distribution of Complete Answers to First and Second Questionnaires 


Regularly Sometimes Almostnever Total 


First questionnaire. 49.3% 33.9% 16.8% 100.0% 
Follow-up card ..... 42.3% 41.6% 16.1% 100.0% 











1 One difference to be noted between the checking of the criginal long 
checklist and the postcards is the greater proportion of no-checks for the 
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There is a slight tendency toward conservatism in the second 
set of replies. That is to say there is a slight decrease in the 
amount of listening claimed. Several factors may be account- 
able for the shift: a feeling on the part of the respondent that 
he is being checked upon and must exercise greater caution; 
greater care in marking two items as against forty-five; or an 
actual decrease in amount of listening as the Christmas rush 
approached. The trend is just on the borderline of statistical 
reliability. 

A similar comparison was possible for the total amount of 
listening. On the original questionnaire, as well as on the sec- 
ond card, the question was asked : ‘‘ About how many hours dur- 
ing the day (before 6 o’clock) is your radio turned on?’’ 

63 per cent of the respondents gave identical numbers of 
hours on the first and on the second occasion. 87 per cent did 
not deviate more than one hour up or down from one question 
to the next. In spite of the fact that only two-thirds of the 
respondents gave identical answers both times they were asked, 
the total distribution of answers for the whole group is prac- 
tically identical. The average amount of listening is 4.7 hours 
if an arithmetic mean is used, and 4.3 hours if we compute a 
median for the original questionnaires as well as for the post 
card follow up. 

After this analysis was completed, we learned that 10,000 
people in rural areas, who hed been interviewed by the Hooper- 
Holmes Bureau for the Joint Committee on Radio Research, had 
been reinterviewed by the same investigators six months later 
(1938) for the Columbia Broadcasting System. The average 
daily listening in the first case was 4 hours, 42 minutes and in 





former. In 51 of the original responses for which postcards were returned, 
too, the program repeated was not checked at all, whereas on the postcards 
only 4 left the program entirely unchecked. It was, of course, simpler to 
check a two-item questionnaire completely than it was to check 45 items. 
For these respondents who did not check the almost never at all, on the 
original questionnaire, the no-checks probably mean almost never. 
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the second case 4 hours, 47 minutes. This compares favorably 
with our result for reliability. 

Our material, it should be stressed, checked the reliability of 
reports on listening habits, that is to say, whether the same 
information is given at two different occasions.* The results 
contribute to the assumption that in spite of quite a number of 
individual changes, information on listening habits is reliable 
if it is taken for a group as a whole. 

2 Frank Stanton has studied the validity of such reports by comparing 
them with the records of an automatic recorder, a device which is inserted 
into the radio set. See: Checking the checkers, Advertising and Selling, 
December 19, 1935. J. G. Jenkins has shown in reports on purchases that 
the validity is smaller than the reliability. See: Dependability of psy- 
chological brand barometers, Jour. Applied Psychology, 22, 1938, 1-7; 
252-260. Incidentally, the high reliability of reports on purchases which 
Jenkins found, has been corroborated on a large scale by the CBS study 
mentioned above. 

















Section IV. Radio in Different Fields of Activity 


Editorial: The papers in this section are all centered around 
an effort to make available statistical material psychologically 
more fruitful. Public opinion polls, accident figures, station 
surveys (and much other material, for that matter, which is not 
covered here) pile up and are forgotten after they have served 
some immediate purpose. The intention was to show how much 
residual value remains in this material. One can hardly exag- 
gerate the potential results which are hidden in the files of all 
data-collecting agencies, if only students would be more inter- 
ested in simple statistical procedures by which the psychological 
implications of these mass surveys could be brought to light. 


THE CHANGE OF OPINION DURING A 
POLITICAL DISCUSSION 


P. F. LAZARSFELD 
Princeton Radio Research Project 


appointment of Senator Hugo Black to the United 
States Supreme Court on August 12, 1937, led to a con- 
siderable amount of unfavorable comment because of his 
alleged association with the Ku Klux Klan. On October 31st, 
in reply to his critics, Justice Black delivered a radio address 
over a nationwide hook-up, explaining his attitude toward that 
organization. In the days following the radio address, the 
American Institute of Public Opinion made a nationwide sur- 
vey asking, among other questions, the following four: 


(4) When President Roosevelt appointed Senator Black to the 
Supreme Court, did you approve of the appointment? 
Yes No  ) “ 
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(5) Do you have a radio? 





RAR ncenceesssiialaipianiis: Mae abaraiiennesetataen 

(6) Did you listen to Justice Black’s radio talk last Friday night? 
Yes No 

(7) Do you think Justice Black should resign from the Supreme 
Court? 
en 


The American Institute of Public Opinion consented to let us 
make a more detailed analysis of approximately 3,000 inter- 
views.* The emphasis of this analysis was laid upon three main 
problems : Who listened to the speech of Senator Black? What 
factors determined the changes of opinion between Black’s 
appointment and his induction into office? What can be 
learned about the role of the radio address in this change of 
opinion ¢ 


THE COMPOSITION OF A POLITICALLY INTERESTED AUDIENCE 

A. If one is to understand what radio means to different 
groups of people, he will have to collect exact information on 
audience composition wherever there is an opportunity to get 
it. Of course the study of one broadcast still leaves many ques- 
tions open. If one group of people was especially interested in 
listening to Justice Black, was it because they were concerned 
with the political implications of the case, or because they 
wanted to hear the voice of a man who had been discussed so 
much? But as such data accumulate, they will check each other 
and finally form a body of knowledge somewhat similar to the 
data available for the psychological analysis of crimes or of 
accidents. 

In order to stress our hope for better generalization, we shall 
assume, hereafter, that listening to Black’s speech means in- 
terest in the issue of the case involved. But lest we lose sight 
of the tentative character of such a conclusion, we shali speak 
about hypotheses rather than results. 

1 This represents one unit of Dr. Gallup’s poll. He informs us that his 
institute decides according to the importance of an issue in how many 


such waves of interviews a question is to be included. For help during 
the tabulation of the cards I am indebted to Mr. Edgar Newhouse III. 
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The punch cards have been analyzed in all conceivable ways, 
but only those tabulations which seem to show anything of im- 
portance are reported here. There is, then, the following series 
of hypotheses to be gained from this survey. 

Hypoth~:is 1. The interest in such a broadcast increases 
with age, and is especially small for people below twenty years 
ofage. Table I gives figures which are self-explanatory. 


TABLE I 
Age and Listening 





17-20 21-25 25-34 35-44 45-54 55-over 





Number interviewed ...... 255 163 . §22 556 449 416 
Proportion listening ... 25% 41% 46% 49% 51% 54% 





Hypothesis 2. The higher the socio-economic status of a 
group, the greater is the interest in such a broadcast. 

In Table II the economic status is measured by the intuitive 
rating method customary in market research.? The table shows 
considerable association between amount of listening and social 
status for the special case under investigation. 








TABLE II 
Listening and Socio-Economic Status 
Above Average 
average Average to poor Poor 
Number interviewed 366 934 427 462 
Proportion listening e 62% 49% 42% 35% 





The high interest in the group above average might be due 
either to the greater average education of this group or to the 
fact that its economic interests were closely connected with the 
appointment of a liberal senator to the Supreme Court. Ap- 
parently the economic factor played a special role because a 
tabulation of listening by occupational groups showed a much 

2Some discussion of this intuitive rating is found in this issue in the 
paper by the writer on Interchangeability of Indices. 
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less sharp distinction. Although there is probably a consider- 
able difference in education between professionals and business 
people, the amount of listening is similar—58 per cent and 
56 per cent respectively ; and both those figures lag behind the 
maximum listening we found when the grouping was done 
essentially according to income, as in the preceding table.* 

Hypothesis 3. People on relief listen more to-such a broad- 
cast than do people of comparable social status who are working. 

The questionnaires used by the American Institute of Public 
Opinion asked for occupation as well as for a rating of socio- 
economic status by the interviewee. Only a few people call 
themselves unemployed, for apparently, many unemployed re- 
ported their usual occupation. More than two-thirds of the 
respondents ‘‘on relief’’ (as economic status) report their occu- 
pation as unskilled workers. The majority of the ‘‘poor’’ 
people are unskilled workers too. It is therefore permissible to 
compare the listening of the ‘‘poor’’ and the ‘‘relief’’ respon- 
dents and interpret the differences as due to unemployment.‘ 

Forty-four per cent of the ‘‘relief’’ group listened, against 
only 35 per cent of the ‘‘poor’’ group. 

Is this greater participation of the unemployed due to their 
having more time to listen or to their feeling that at present 
their relief income is so closely related to political events? 
Unfortunately it is not possible to decide this question without 
further knowledge of the usual listening habits of each of the 
respondents. Further research is needed in this field. (Some 
preliminary information is provided in the communications of 
Holter and Fiske and Meyrowitz, in this issue.) 

8 Forty-three per cent of the farmers listened as compared with 48 per 
cent of the skilled workers and 39 per cent of the unskilled workers. The 
differences are too small to warrant a special interpretation. 

4To be quite sure of this result, a special tabulation was made per- 
taining to unskilled workers only and comparing those on relief with those 
not on relief, a difference which for this group practically coincides with 
employed and unemployed. The percentage of listening for these two 
groups showed exactly the same difference as did the one between ‘‘poor’’ 
and ‘‘relief,’’ in general. This is, of course, not surprising, in view of 
the fact that the majority of both groups consists of unskilled workers. 
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B. None of the other primary characteristics such as sex, size 
of town, or geographical area showed any relation to the amount 
of listening. As listener research develops, it will be necessary 
to determine the psychological characteristics of listeners to dif- 
ferent types of broadcasts. In this survey, no such index has 
been used. It happened, incidentally, that a question was in- 
cluded about the respondent’s big-league baseball interests. In 
our analysis, we tried to use that as an inferential psychological 
index, but it did not show any relationship to listening. 

We know, however, how each respondent felt about Justice 
Black at the time of his appointment about six weeks preceding 
the radio speech. Although, as shown later, this opinion prob- 
ably had changed meantime, the relationship between original 
opinion and amount of listening suggests the following par- 
ticularly important result. 

Hypothesis 4. In connection with a major controversial 
issue, people listen to an isolated radio speech (as distinguished 
from one of many given in a campzign) irrespective of their 
opinion on the case, but those who have no opinion are much less 
likely to listen. 

Table III gives the corroborating evidence in this special 
case.® 











TABLE IIl 
Listening and Opinion at Time of Appointment 
Opinion Listened Total interviewed 
Favorable 56% 814 
Urfavoradle nicccccccccccssccccccscesmn 57% 658 
No opinion 31% 885 








It is surprising that the proportion of listeners among those 
who had no opinion is almost a third. It is probable, however, 
5 A similar result was found in a small study done for the Princeton 
Radio Research Project in New York City during the last campaign for 
governor. About half of all voters reported listening to some radio 


speech, but only 16 per cent of the non-voting respondents had heard a 
candidate over the air. 
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that those who originally had no opinion but who listened to the 
speech consisted of several groups at the time of the broadcast : 
those who had in the meantime acquired an opinion ; those whose 
lack of opinion was not due to lack of interest but who were 
really undecided ; those who had more recently become familiar 
with the controversy on the appointment and wanted to obtain 
some impression to keep abreast of developments ; and those who 
listened because their radio happened to be tuned in at the time 
of the broadcast. More evidence on this point will be given in 
the appendix to this paper. 

Professor H. Cantril was kind enough to comment on some of 
the results in this section. Here is his interpretation. 

Hypothesis 2. People of higher social economic status have frames of 
reference which are better structured, more highly rationalized, more readily 
applicable to a variety of situations. They would, then, have frames of 
reference that would enable them to detect better the meaning which the 
appointment would have for their own future experience. For most un- 
educated Americans the workings of the Supreme Court are probably too 
remote and complex for them to begin to understand, and any opinion 
they may have would be a carry-over of some applicable (but not specifi- 
cally pointed) frame of reference (i.¢., one toward Roosevelt). 

Hypothesis 3. Reliefers would take more interest in this issne because 
again there is more ego-involvement. They may not understand the issue 
much better than poor workers, but since Roosevelt is involved, and since 
the intensity of their attitude toward Roosevelt is probably greater than 
the intensity of poor workers, this attitude would carry over to one of 
Roosevelt ’s acts. 

Hypothesis 4. One of the chief reasons for the increased interest of 
**no opinion’’ people in Black’s talk could be conceptualized as follows: 
A large number of people had no particular interest in the appointment 
when first asked about it. Nor had they any opinion. As public discus- 
sion mounted, they obtained a derived interest in the question. They 
still had no attitude (frame of reference; standard of judgment) but 
they had a derived need for one. Hence, they listened to the talk to try 
to get some direct experience by means of which they could acquire a 
standard of judgment. 


WHAT DETERMINED CHANGE OF OPINION ? 


| A. With the character of Justice Black’s radio audience well 
| in mind, let us now consider the changes of opinion that took 


ae Neo nee a Smtr 
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place among his listeners during the time which elapsed between 
his appointment and a date three days after his broadcast.® 

In spite of all the commotion which the Black case aroused, 61 
per cent of the people covered by this study did uot change their 
opinion between the time of Black’s appointment and the time 
he actually took office. A majority of the others had had no 
opinion at first but had acquired an opinion during the public 
discussion. The following table gives the general picture :’ 


TABLE IV 


Distribution of Comparative Attitudes between the Beginning and 
the End of Public Discussion 

















No change of attitude 61% 
Acquired an opinion (positive or negative) 21% 
Shifted opinion (from positive to negative or the other way 
around ) 12% 
Became undecided (shifted from positive or negative to no 
opinion) 6% 
Total 100% 








* Throughout the following pages reference will be made to ‘‘ previous 
opinion’’ and ‘‘present opinion,’’ referring respectively to Questions 4 
and 7. Those people who answered that they were originally in favor of 
the appointment will be credited with a ‘‘previous favorable opinion; ’’ 
those who were against Justice Black’s resignation at the moment of the 
survey will be credited with a ‘‘present favorable opinion.’’ The same 
procedure will be followed correspondingly for negative opinions. The 
questionnaire had a provision for people who had ‘‘no opinion’’ on either 
of the two questions, and this information will be used accordingly. All 
the tables in this paper refer only to those respondents who stated that they 
owned a radio. 

tT The objection could be raised that people do not remember or do not 
report correctly their attitude at the time of the appointment. And, 
indeed, the more correct procedure would be to interview those people 
twice; once at the beginning and once at the end of the discussion. 
There is in this special case, however, an opportunity to infer the valid- 
ity of the data collected. The Institute had actually made a survey at 
the time of Black’s appointment. The distribution of opinion at the 
time of the appointment was practically the same as the one reported in 
this survey as ‘‘ previous opinion.’’ 
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The result suggested here is that the main effect of such a 
public discussion is to form the attitudes of those people who 
originally had no opinion on the issue involved. This result is 
still more interesting if one realizes that the net effect of this 
particular discussion was inconsequential as far as the relative 
strength of the two groups was concerned. That is clearly 
shown in the following table: 


TABLE V 


Distribution of Attitude at the Beginning and at the End of the 
Discussion 





Favorable Unfavorable Noopinion Total 


Time of appointment .... 35% 28% 37% 100% 
Time Of SUrVey o..ccccc. ccc 42% 34% 24% 100% 








The ratio of favorable to unfavorable opinion is the same at 
the begining and at the end of the discussion. 

B. A more compiete analysis of the 39 per cent who changed 
their opinions shows an interesting psychological characteristic 
of this change. In anticipation of the discussion to be given 
presently, we can say: The result of propaganda and discussion 
following the appointment of Black was (for a considerable por- 
tion of the population) that what was a socio-political issue to 
begin with turned into a racial-religious one. 

To substantiate this result, let us consider for the time 
being only the 39 per cent of the respondents who changed their 
attitude in one way or another. Black definitely had the repu- 
tation of being a New Dealer, and accordingly at the time of his 
appointment the Democrats were more in favor of him and the 
Republicans were more against him, insofar as they were inter- 
ested at all in the issue.* 

The Catholics and Jews who later on were to oppose Black so 
strongly were much more for him than the Protestants. 

8 The definition of a Republican (or correspondingly a Democrat) was 
a respondent who had voted for Landon in 1936 and would still vote for 


him at the time of the survey. Although this reduces the number of cases 
available for analysis, it puts the interpretation on safe ground. 
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TABLE VI 
Political Affiliation and Attitude at the Time of the Appointment 





Favor- Unfavor- No Total Total 
able able opinion number 


35% 12% 53% 100% 370 
14% 37% 49% 100% 240 








TABLE VII 


Religion of Respondent and Political Opinion at Time of Appointment 
among Those Who Later Changed Their Attitude 





Favor- Unfavor- No Total Total 
able able opinion number 


Protestants ............... 20% 23% 57% 100% 422 
Catholics and Jews 41% 14% 45% 100% 223 








We are inclined to interpret this as merely a consequence of 
the political line-up at the time of the appointment. It is 
known (and will be shown presently in this paper) that 
Catholics and Jews are more likely to belong to the Democratic 
than to the Republican party. If we assume, further, that they 


are more likely to belong to the liberal wing of the Democratic 
Party, they will, as a matter of course, favor offhand the 
appointment of a Senator with a definitely liberal record. The 
assumption that Catholics and Jews in the Democratic Party are 
more likely to support the New Deal as compared with the aver- 
age Protestant party member could easily be checked in other 
surveys of the American Institute of Public Opinion. In the 
present survey the only inferential evidence is the relation be- 
tween religion and occupation, which we have tabulated. The 
proportion of ‘‘Catholics and Jews’’ among industrial workers 
is much higher than among other occupational groups and it can 
certainly be taken for granted from other studies that industrial 
workers are in favor of the New Deal.’ 


® For each 100 Protestants the number of Catholics and Jews in this 
survey was the following: 19 among farmers; 33 among professional and 
business men; and 56 among skilled and unskilled workers. 
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In the light of this interpretation the last two tables show that 
at the begining the racial-religious issue which was to evolve 
later, played no role in the formation of opinion, the socio- 
political aspect accounting mainly for the division of opinion. 

At the time of the survey when six weeks of propaganda and 
discussion had swept the country, the opinion of the same group 
of people was related to their religious background in a very 
different way. 

TABLE VIII 
Present Opinion and Religious A ffiliation 





Favor- Unfavor- No Total Total 
able able opinion 





number 
Protestants ............... 51% 31% 18% 100% 422 
Catholics and Jews 30% 57% 13% 100% 223 





The association between religious affiliation and opinion is 
completely inverse to the one shown in Table VII. Catholics 
and Jews are now preponderantly against Black although they 
were much more likely to be for him at the time of the appoint- 
ment. 

It is now the party affiliation which has become inconsequen- 
tial. The over-all figures show that the Republicans are now 
even more in favor of Black than the Democrats. 


TABLE Ix 
Present Opinion and Political Affiliation 


Favor- Unfavor- No Total Total 
able able opinion number 


Democrats -..cccccconn 41% 43% 16% 100% 370 
Republicaus ..... 50% 34% 16% 100% 240 











This inverse association between political affiliation and 
opinion is now essentially a consequence of the greater propor- 
tion of Jews and Catholics in the Democratic party than in the 
Republican party. 

This becomes especially clear when political and religious 
affiliations are taken into account simultaneously. The number 
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of respondents who are definitely Republicans and Catholics or 
Jews is very small (only 16 cases). Therefore, the analysis has 
to be confined to Protestants. The following table gives past 
and present opinion for those respondents who could be defi- 
nitely identified as Protestants and members of one of the two 
political parties. 

TABLE X 


The Distribution of Past and Present Opinion among Those Protestants 
Who Changed Their Attitude 











Past opinion Present opinion 
Democrats Republicans Democrats Republicans 
Favorable ............. vt 26% 14% 53% 49% 
Unfavorable .......... 14% 31% 31% 387% 
No opinion ........... i 60% 55% 16% 14% 
* OER ciniaipiiwne —— 100% 100% 100% 100% 
Total number. 118 143 118 143 





The strong association between party membership and 
opinion which prevailed at the time of appointment had prac- 
tically disappeared when the survey was made six weeks later. 

We are now in a position to summarize what the survey seems 
to show regarding the change of opinion in such a political dis- 
cussion : 

(a) The main bulk of the change comes from those people 
who originally had no opinion on the matter and made up their 
minds one way or another during the public discussion. 

(b) The relative strength of the two kinds of opinion—for or 
against the appointment—remained unchanged. 

(ec) The alignment of the group which shifted attitude was 
of a different kind at the beginning and at the end of the discus- 
sion : Whereas they first were divided on the topic of liberalism 
versus conservativism, in the end they were opposed along 
religious lines. 

To what extent the substitution of a racial-religious issue for 
a socio-economic one is characteristic of a great part of modern 
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propaganda, is a question which remains a challenge for further 
research. 


GENETIC ATTITUDE RESEARCH 


The problem now arises as to what distinguishes the 39 per 
cent who changed their attitude one way or another from the 
61 per cent who did not. Evidently the issue itself will not 
supply the answer. Among those unaffected by the public dis- 
cussion were adherents of both parties and members of all re- 
ligious groups. These possibilities offer themselves as explana- 
tions : 

(a) Perhaps those who shifted were personalities especially 
susceptible to propaganda. 

(b) Perhaps the people who shifted were those for whom the 
racial-religious aspect of politics was particularly important. 

No data bearing on the first possibility are available because 
nothing is known about the personalities of the respondents. 
We analyzed the primary characteristics of those who shifted 
against those who did not shift, comparing them according to 
sex, age, residence, occupation, and economic status. The only 
relationships found were slightly more shifts among the 
youngest age group, and definitely fewer shifts among the 
farmers. 

The second interpretation just suggested seems to be sup- 
ported by our material. There is, as was already mentioned, a 
definite interconnection between religious and political affilia- 
tion as shown in the following table. 








TABLE XI 
Political and Religious Affiliation 
Catholics 
anil Jews Protestants Total 
Republicans ..................... 44 402 446 
Deermocrats eseccsccsescseereeeseree 268 412 680 
Total 312 814 1126 
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Measured by the tetrachoric coefficient of correlation,” this 
table correspoxds to a value of .54. But people who later on 
shifted their attitude on the Black issue show from the begin- 
ning a stronger association of political and religious beliefs than 
the people who did not change during the public discussion. 
The 61 per cent of the sample who did not change their opinion 
between the time of Black’s appointment and the time of the 
survey right after the radio speech show a correlation of .46 
between membership in the Republican or Democratic party on 
the one side, and Protestant and Catholic-Jewish religion on 
the other side. The group which actually shifted shows a 
correlation of .69 between political and religious affiliation. 
It must be clearly remembered that those correlation coefficients 
are computed irrespective of the data pertaining to the Black 
issue. They characterize the structure of affiliations in the two 
groups. The difference, therefore, in the two values of the 
coefficient points to a relationship between opinion structure 
and susceptibility to propaganda. 

This result indicates a kind of research which so far has not 
received much attention. The way an individual acquires an 
opinion may be quite indicative of how resistant this opinion 
will be against external influence. The much discussed ques- 
tion of educating people to understand propaganda might be 
clarified by such a comparative biographical analysis of people 
who did and people who did not change a belief. 

Professor H. Cantril, agreeing with this interpretation, suggests the 
following formulation: The 61 per cent who did not shift their attitudes 
were people who had well-structured political frames of reference. Also 
they were people for whom the political attituds of libralism-conservatism 
meant more (involved more of the ego) than did religious or racial atti- 
tudes. Those who shifted from for to against or against to for were indi- 
viduals who first gave political opinions that were not so closely related to 
the ego as their racial-religious opinions. When the latter issue became a 
possible issue, the more important attitude for these people became the 
determinant ; their mental fields were reorganized around a new standard of 
judgment which involved more for them personally. Since being a Catholic 


10 L, Chesire, M. Saffir, and L. L. Thurstone, Computing Diagrams for 
the Tetrachoric Correlation Coefficient, 1933. 
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or being a Jew obviously affects most Catholics or Jews more strongly than 
being a Republican or Democrat (since it involves more of their daily 


life, has more meaning for them), this argument would have common sense 
to back it up. 


APPENDIX ON THE ROLE OF RADIO 


The Need for a Subjective Question 


From the survey made by the American Institute of Public 
Opinion, it is not possible to determine with certainty what role 
Black’s radio speech played in the change of opinion. This 
shortcoming brings out a research problem which is worthy of 

The respondents were asked their opinion at the time of the 
appointment and their opinion at the time of the survey which 
was taken six weeks later, right after the speech. If there was 
a change of opinion, it could have taken place at any time during 
those six weeks, and so we do not know whether the change 
occurred in the long period before the speech or in the brief 
period after the speech. Yet this information would be decisive 
in the evaluation of the effect of the speech because obviously it 
could only affect changes following the broadcast. 

It would have been very easy, even in a mass survey, to ask 
those people who reported a change in opinion and also reported 
listening to the speech, the following question: ‘‘Do you think 
that the speech has had anything to do with your change in 
opinion?’’ We are quite positive that this special group of 
listeners and shifters for which the question was appropriate, 
would have been able to give an intelligent answer, but somehow 
such questions still conflict with the convictions of many stu- 
dents in social research. The Princeton Radio Research Pro- 
ject will therefore devote a special monograph to the discussion 
of under what conditions such ‘‘subjective questions’’ should 
be used in mass surveys. At the present time one bit of evi- 
dence will be introduced because it is so near to the ease under 
consideration. 
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In a study of another special radio program on a political 
topic, Jeannette Sayre sent an attitude scale to 150 persons on 
a subject which was to be discussed over the radio a few days 
later. After the broadcast, she received replies from the same 
subjects on the same attitude scale. In addition to that, she 
asked the respondents whether they felt that the broadcast had 
changed their minds on the topic of the discussion. In this way 
it was possible to compare the impressions of the subjects as to 
whether they had been influenced, with the actual change in 
their replies to the attitude scale. She found that those people 
who felt that they had been influenced showed considerably 
more shifts in their attitude as measured by the scales, compared 
with those who felt that the program had not influenced them. 
Miss Sayre’s publication will thus prove the validity of a sub- 
jective question on changes which would make the evaluation 
of this survey so much more fruitful. It is mainly for the sake 
of contrast that we summarize the rather complicated considera- 
tions which are necessary to infer the role of radio from the 
present data. 


Assuming that Opinion Determines Listening 


Two extreme situations can be assumed, the actual develop- 
ment being somewhat in between. We may either assume that 
all the changes in opinion were due to the radio speech, or we 
may assume that listening to the radio speech was determined 
by the change of opinion which had already occurred. 

Under the latter assumption, we can draw on a classification 
somewhat similar to that of Table IV. The following table 
would then show that those people who are most likely to listen 
are those who stuck to their original opinion on the issue. Then 
come those who shifted from one opinion to another. Less 
likely to listen were those who acquired an opinion during the 
general discussion, and still less likely, were those who either 
lost their interest or became uncertain between the time of the 
appointment and the time of the broadcast. Those respondents 

1 The results will be discussed in detail in a special publication. 
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who never had and never acquired an opinion furnish only a 
very small group of listeners. 


TABLE 1 


Proportion of Listening among Groups Representing Different Combina- 
tions of Previous and Present Opinion 











Unchanged positive or negative opinion , 60% 
Shift from positive to negative opinion or inversely ................... 53% 
Shift from no opinion to some kind of opinion ....... 45% 
Shift from opinion to no opinion 33% 
No opinion at all 15% 








Assuming That Listening Determines Opinion 

If, on the other hand, we surmise that all change in opinion 
was due to the radio talk, we have to compare the changes in 
opinion of those who listened and those who did not listen to the 
radio talk. In this case we would get three pieces of informa- 
tion. 

(a) Those who listened were less likely to change their 
opinion than those who did not listen. To clarify the sense of 
this result, we should have to assume tat the talk made the 
followers of Justice Black more friendly and his enemies still 
more unfriendly toward him. 


TABLE 2 
Proportion of People Who Did Not Change Their Opinion 





Favorable opinion Unfavorable opinion 


Listened 79% 76% 
Did not listen ............... whe 66% 66% 











The preceding table shows that the proportion of people hav- 
ing the same opinion after the talk as at the time of appointment 
is greater among listeners than among those who did not listen. 

(b) The listeners to the radio speech were more likely to take 
sides than those who did not listen. The following table shows 
that the proportion of people without opinions is much smaller 
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among the listeners than among non-listeners for each type of 
previous opinion. 
TABLE 3 
Proportion of People without Opinion After the Speech 





Non-listeners 


Previously favorable 13% 
Previously unfavorable 16% 
Previously no opinion 59% 








Assuming that the change of opinion is an effect of the speech, 
we should have to interpret this result as meaning that the 
speech kept the listener from losing interest or a personal 
opinion regarding the issue. 

(ce) Among the people who had no opinion to begin with, the 
listeners showed after the talk a much greater proportion of 
opinions than the non-listeners. The ratio of favorable and 
unfavorable opinions, however, is practically the same for both 
groups. 

TABLE 4 
Acquiring of an Opinion by Those Who Had None Previously 





Now favorable Now unfavorable 


Listened 47% 30% 
Did not listen 25% 17% 











Under the current assumption, then, that would mean that 
although the speech makes people more determined, it does not 
influence the content of their opinion differently from the way 
the general trend of the discussion influenced the non-listeners. 

This set of results is rather involved and does not correspond 
very closely with general experience. Common sense and the 
trend of the figures would lead one to believe that it was the 
change of opinion which determined whether people listened 
rather than their listening determining their change of opinion. 
There is, however, no way of making a final judgment in this 
matter. 
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RADIO LISTENING AND AUTOMOBILES 


EDWARD A. SUCHMAN 
Princeton Radio Research Project 


I. PROBLEM: RADIO INSTALLATION AND ACCIDENTS 


N 1930 radio first entered the field of automobile transporta- 
tion. By 1938, over 5,000,000 radio-equipped automobiles 
were in operation in the United States. This rapid in- 

crease of radios in automobiles was followed with dark fore- 
bodings by many motor-vehicle and traffic officials. State legis- 
latures took up the cry, and before long were called upon to pass 
bills condemning the use of automobile-radios upon the state 
highways. An official inquiry was first made in 1930 by the 
Massachusetts Registrar of Motor Vehicles, and similar investi- 
gations in New York, New Jersey, Illinois, Ohio, and other 
states followed. These surveys, consisting primarily of inter- 
views with motorists and traffic officials, were sufficient to pre- 
vent regulation. Members of the National Organization of 
Motor Vehicle Commissioners, for instance, considered action 
unnecessary. Other investigations by public-service and police 
authorities also vindicated the automobile radio.’ 

Reports at one time indicated that several states refused 
to register motor vehicles with radios, but these regulations were 
never enforced. Several public officials expressed opposition. 
The Commissioner of Motor Vehicles of one state passed a ruling 
that listening to radios while driving in congested districts 
would be considered interference with proper operation of the 
vehicle, but again enforcement was not attempted. Likewise 
when Washington, D. C., ruled that ‘‘no taxicab equipped with 
a radio shall be operated while such radio is in operation,’’ 
the rule was not enforced.* 

Facts and figures on the percentage of highway accidents 

1 Compiled by Radio Today for the World Almanac of 1939. 

2 Statement and Brief of Radio Manufacturers Association, Hearing 

February 18, 1937, Idaho House of Representatives. 
3 National Safety Council, Public Safety Memo, No. 48, March 1935. 
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attributed to radio are completely lacking and difficult to 
obtain. The legislatures can refer only to the private opinions 
of motor-vehicle and traffic officials. No statistics are available 
on either the number of accidents traceable to the radio or the 
percentage of vehicles with radio sets. Both sets of figures are 
necessary before any reliable conclusions can be drawn. The 
evidence at present is largely theoretical and based on indi- 
vidual opinion. The Automobile Club of New York, in a poll 
of New York City’s motorists in March, 1934, found that 56 
per cent of the drivers opposed the automobile-radio on the 
ground that it distracted the driver of the car as well as drivers 
of other cars. Recently, however, the Minister of Transports 
in London declared that ‘‘no evidence has been found to sug- 
gest that the use of car-radios should be prohibited on the 
grounds of safety.’"* Many cities maintain police cars equipped 
with radios and the police departments of these cities report no 
noticeable increase in the number of accidents. Recently a 
trucking firm in Newark, New Jersey, by installing radios in 
its fleet of 125 trucks, proved to its own satisfaction by a sub- 
stantial reduction in highway mishaps that the radio was a 
**boon to safety.’ An analysis of 2,000,000 questionnaires 
mailed to car owners in all sections of the country by the Gen- 
eral Motors Corporation showed that an overwhelming majority 
of the boys and girls want radios in their cars.5 The Radio 
Manufacturers Association asked the motor-vehicle commission- 
ers of forty-four states for their opinion of the relation of auto- 
mobile-radios to traffic accidents. Only officials of Idaho and 
Wisconsin declared themselves for restriction, officials from four 
states were noncommittal, while thirty-eight state commission- 
ers registered the opinion that their records do not show any 
traffic accidents attributed to automobile-radios.* Nowhere, 
however, do we have any statistics to indicate to what extent 

4'W. CU. Harvey, ‘‘Shall They Have Music?’’ Christian Science Moni- 
tor, September 16, 1936. 

5 Customer Research Staff, General Motors Corporation, Release Sep- 
tember 16, 1934. 

6 Op. cit., p. 5. 
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accidents can be traced to the interference of radios with the 
driver’s hearing or attention. 


II. METHOD AND RESULTS 


The following study, while only an exploratory approach, 
attempts to obtain statistical knowledge concerning the rela- 
tionship of automobile-radios to accidents. On November 23, 
1933, the first radio-equipped taxicab appeared on the streets 
of New York City. After successfully defending itself against 
prohibitory legislation, the radio-cab spread rapidly until in 
June 1936 all major cab fleets, totaling approximately 10,000 
cabs, were equipped with radios. From January 1934 to March 
1936, however, about an equal number of radio and non-radio 
cabs were operating in New York City. How do these radio 
and non-radio cabs compare as to number of accidents per 
hundred cars? In the following study the accident records 
of two major taxicab companies are analyzed in an attempt 
to study this question in a characteristic situation. The records 
may be divided into three periods—period 1 from January 1933 
to December 1933, when both Companies ‘‘ A’’ and ‘‘B’’ did not 
have radios in the cabs; period 2 from January 1934 to March 
1936 when Company ‘‘A’’ had radios but Company ‘‘B’’ did 
not; and period 3, from April 1936 to December 1937, when 
both companies had radios. 

Table I shows the accident rate for each type of cab taken 
quarterly from January 1933 to December 1937 and divided 
into the three periods mentioned above.’ At first glance, this 
table seems to indicate that the cabs with radios have much 
fewer accidents than cabs without radios as compared during 
the latter part of the second period. This difference, however, 
is quite abrupt and continues throughout the third period 
despite the fact that both cabs have radios. Also, it could not 
be related in any way to the installation of the radios, since the 
difference occurred 15 months after the radios were installed. 


7 These figures were obtained through the courtesy of the Public Ser- 
vice Mutual Casualty Insurance Company. 
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TABLE I 
Number of Accidents Per 100 Cabs Taken Quarterly 
Difference 
Quarter Company Ong oc Goer 
pany s¢A? > 
: No radio N i 
Period 1 (320 cabs) (348 cabs) 
1933 
Jan. to Mar... 113.9 114.1 - 0.2 
Apr. to June ..... 84.8 93.8 — 9.0 
July to Sept... 86.8 96.8 -10.0 
Oct. to Dee. .... 132.2 125.8 + 6.4 
Period 8 (870 cabs) (410 eabe) 
1934 
Jan. to Mar. ..... 107.8 110.7 - 3.1 
April to June... 103.1 108.0 - 49 
July to Sept. ..... 115.8 113.8 + 2.0 
Oct. to Dee. ...... 146.0 148.5 - 2.5 
1935 
Jan, to Mar. ....: 141.5 135.5 + 6.0 
Apr. to June ..... 110.7 146.3 —35.6 
July to Sept. ... 96.4 128.9 32.5 
Oct. to Dec. ... 113.7 142.0 —28.3 
1936 
Jan, to Mar. ..... 155.7 191.2 —45.5 
Period 8 (T10 eabe) (410 cate) 
1936 
Apr. to June* . 110.5 141.6 -31.1 
July to Sept.* .. 101.4 110.1 - 8.7 
Oct. to Dec. .... 156.7 188.6 -31.9 
1937 
Jan. to Mar. .... 137.1 159.7 —22.6 
Apr. to June ..... 143.8 172.9 —29.1 
July to Sept... 103.5 130.3 -26.8 
Oct. to Dec. ... 133.9 156.7 —22.8 





*The figures for these quarters are not entirely accurate because the 
number and type of cabs varied from day to day as the old fleets were 


SE 





gradually replaced. 
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ste st ines nar sinaltiet 


This period is too long for a possible ‘‘lag’’ before the effect was 
noticed. Evidently some other factor beginning during the 
second quarter of 1935 accounts for this difference. Interviews 
ij with officials of both companies disclosed that this difference 
probably resulted from a change of Company ‘‘A’s’’ policy in 
reporting accidents, put into effect by Company ‘‘A’’ during 
the second quarter of 1935. The effect of this sudden change in 
policy on the part of Company ‘‘A’’ appears clearly in Table I. 
Whereas the accident trend for Company ‘‘B’’ increases at a 
constant rate throughout the five-year period, the trend for 
Company ‘‘A’’ increases at the same rate as Company ‘‘B”’ 
until the second quarter of 1935, when it takes a sudden drop. 
This difference remains throughout 1936 and 1937, but the num- 
ber of accidents of both companies still continues to increase at 
the same rate. 

In order to enable us to compare directly the second period 
during which one company had radios and the other did not, 
we have made a correction in the accident rate of Company 
‘*A.”’ To find this correction we took the average amount of 
difference between the two companies for the third period, 
during which time both companies had radio-cabs and when 
the only factor that could account for a difference in accident 
rate was company policy. This correction factor was found to 
be 26.6 + 3.1 accident per 100 cabs taken quarterly. Since the 
change in trend occurred with Company ‘‘A,’’ we added the 
correction factor to this company. Since this change took place 
during the second quarter of 1935, the correction was begun 
there. Table II gives the corrected accident rate from January 
1934 to March 1936, replacing period 2 of Table I and repre- 
senting that period when Company ‘‘A’’ had radios and Com- 
pany ‘‘B”’ did not. 

From this table we see that the difference in accident rate 
between radio and non-radio cabs is slight and similar to the 
differences found in period 1, when neither cab had radios, and 
period 3, when both cabs had radios. We conclude from this 
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TABLE II 
Number of Accidents Per 100 Cabs Taken Quarterly for Radio 
and Non-Radio Cabs 
(Figures corrected according to text) 








— a Oo” lke 
(870 cabs) (410 eabs) 2 ony? 
1934 
Jan. to Mar... 107.8 110.7 - 2.9 
Apr. to June .... 103.1 108.0 - 49 
July to Sept... 115.8 113.8 + 2.0 
Oct. to Dec. ... 146.0 148.5 - 25 
1935 
Jan. to Mar... 141.5 135.5 + 6.0 
Apr. to June .... 137.3 146.3 — 9.0 
July to Sept... 123.0 128.9 - 59 
Oct. to Dec. ... 140.3 142.0 ~17 
1936 
Jan. to Mar... 182.3 191.2 - 89 





evidence that radio has little effect upon the safety of taxicab 
operation. 


III. PSYCHOLOGICAL ASPECTS OF THE PROBLEM 


The taxicab situation is, of course, a complex one and not 
completely comparable to ordinary automobile cperation. A 
cab is on the street 24 hours a day and is constantly in the 
midst of city traffic. The passenger, not the driver, usually 
adjusts the radio. Also, the taxicab driver is an expert in the 
handling of a cab and not easily affected by any distraction 
the radio might cause. 

In order to study the effect of radio listening in greater 
detail, 25 taxi-drivers and 25 drivers of private vehicles were 
interviewed in detail. Arguments were advanced both for and 
against automobile-radios. A summary of the points brought 
out in these interviews and in the references mentioned above 
is given below. 
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A. Radio as a Traffic Hazard 


(1) Diverts the attention of the driver while driving. Motor- 
ists tuning in on reports of prize fights, baseball games, mystery 
plays, or other exciting broadcasts are likely to have their atten- 
tion distracted from driving. 

(2) Prevents the driver from hearing warning signals. To 
quote from a letter by the Department of Motor Vehicles of 
the State of California : ‘‘ A survivor in one fatal accident where 
a radio was playing in a car while crossing a railroad track 
stated that he faintly heard a train whistle but the driver, being 
closer to the radio, did not hear it. The driver was killed.’’ 

(3) Diverts the eyes from the road and ears from outside 
warnings because of the manual operation required. While one 
is driving in heavy traffic, the slightest inattention to the road 
may result in an accident. 


B. Radio as a Safety Factor 


(1) Induces slower driving. Programs are less apt to be 
enjoyed while cars are speeding. In the absence of automobile- 
radios, the operator’s speed is qualified only by traffic con- 
ditions. 

(2) Keeps motorists alert. This is especially true for ex- 
tended journeys and night driving. The automobile-radio tends 
to promote attention, wakefulness, interest, and alertness. It 
breaks the monotony and prevents drowsiness. 

(3) Reduces disturbing conversation. The occupants of the 
car are entertained and therefore more quiet. By eliminating 
exciting debate and argument it causes calmer driving. ‘‘Back- 
seat driving’’ is reduced. 

(4) Reduces impatience and annoyance with traffic. Stead- 
ier, easier, and safer driving results from reducing the hazards 
of cutting in and out of traffic lanes. The driver, being enter- 
tained, does not mind waiting. The tendency to ‘‘jump”’ the 
green light is reduced. 


Perhaps the crux of the situation lies in the relative merits 
of the automobile-radio as a safety factor or as a traffic hazard. 
A study might be made using the above points as a check 
list to obtain the opinion of drivers, traffic officials, and others. 
It seems so far that interviews with drivers of automobiles 
not equipped with radios result in quite different attitudes from 
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those with drivers of radio-equipped automobiles. Tlose peo- 
ple who do not have radios in their cars seem much more opposed 
to them than people who have automobile-radios. 

This suggests an interesting hypothesis. It may be that there 
is an internal self-correcting factor which helps account for the 
lack of effect automobile-radios seem to have upon accidents. 
Those people who would be more likely to have accidents were 
they to listen to the radio while driving, do not install radios 
in their automobiles. Thus all car-owners might be divided 
into radio-sensitive and radio-non-sensitive groups. The radio- 
sensitive group, liable to accidents because of radios, do not have 
radios, and condemn radios as hazardous. The radio-non-sensi- 
tive group, unlikely to have accidents because of radios, have 
radios and claim they are not traffic hazards. If it is true that 
radios do not cause accidents, this hypothesis would help ac- 
count for the lack of accidents, since those people having radios 
in their cars are radio-non-sensitive to begin with. A distinc- 
tion must be made, of course, between automobile owners not 
having radios because they are opposed to them and those 
not having radios because they merely cannot afford to install 
them.® 


IV. APPENDIX ON THE PASSENGER 


Quite obviously before the radio can be a traffic hazard, it 
must be playing. The following study determines to what ex- 
tent and under what conditions the radio was listened to. In 
addition to the present problem, this study is interesting as a 
reflection upon the listening habits of the quarter-million cab- 
riders per day in the city of New York.°® 

The method used was simple. The reactions of the passenger 
to the radio were noted by the driver of the cab, without the 


8 This grouping of automobile drivers has a parallel in Snow’s division 
of all drivers into three groups in relation to their sensitiveness to auto- 
mobile accidents: ‘‘accident-prone,’’ ‘‘accident-liable,’’ and ‘‘ accident- 
free.’’ 

® This study was made possible through the cooperation of the Sun- 
shine-Radio Cab System. 
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passenger’s being aware of the fact. Two opposing experi- 
mental situations were used. In Experiment A, the drivers 
were instructed to have their radios on when the passengers 
entered the cab. In Experiment B, the drivers were instructed 
to have their radios off. The above two situations served as 
independent checks upon each other. 

The results of the study are given in Table ITI. 


TABLE III 
Passenger Reaction to Radio in Cab 


Exp. A—Radio on at beginning of ride (735 cases) 
1. Left it on 81.9% 
2. Turned it off .... 18.1% 

Exp. B—Radio off at beginning of ride (926 cases) 
1. Left it off 69.9% 
2. Turned it on ..... 30.1% 














From this we may say that the radios in the cabs are in opera- 
tion a great part of the time the cabs are moving, and might pos- 
sibly interfere with the safe operation of the vehicle. It is 
interesting to note that nearly twice as many people turned the 
radio on as turned it off. 

It was also possible to study how the amount of radio listening 
varies with the conditions of the ride. Table IV shows the rela- 
tionship between radio-listening and length of ride as deter- 
mined under our two opposing experimental situations. 

TABLE IV 
Radio Listening by Length of Cab Ride 





Exp. A—Radio on Exp. B—Radio off 


Length of ride Total Per cent Total Per cent 
oe radio on — radio on 











Less than 3 mi... 460 80.0 570 22.6 

3-5 miles 190 82.3 250 29.9 

“eee 86.9 62 62.8 

Over 8 miles .................. 39 87.2 44 80.1 
735 926 
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From this table we see that there is a direct relationship be- 
tween the length of the ride and the number of cases of listening 
to the radio—the longer the ride, the greater the number of 
listeners. This is brought out in both experimental situations. 

Another interesting factor was found to be time of day, as 
shown in Table V. The greatest amount of radio listening in 
cabs is found to occur between eight in the evening and four in 
the morning. 











TABLE V 
Radio Listening in Cabs by Time of Day 
Exp. A—Radio on Exp. B—Radio off 
Time of day Per cent Per cent 
Total leaving Total turning 
— radio on — radio on 
8 P.M. to 4 A.M. ........... 396 89.6 346 35.0 
4 a.M. to 12 noon ..... 130 79.2 240 29.2 
12 noon to 8 P.M. ... 209 60.2 340 25.9 
735 926 





Other points of interest found were: (1) Women tend to 
listen slightly more than men. (2) As the number of pas- 
sengers increases the amount of listening increases. (3) The 
least amount of radio listening is done when the passengers 
come in ‘‘couples,’’ that is, are equally divided as to sex. (4) 
Three out of every four passengers who listen at all, listen to 
music. (5) About half the people who listen change the pro- 
gram already on the radio when they enter the cab, to some 
other program. 

In general then it was learned that listening depends a great 
deal upon the situation the passenger finds himself in at the 
moment he enters the cab. We also find the group which 
entered the cab with the radio off and turned it on, more sensi- 
tive to those factors affecting radio listening. 
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THE RELATIVE PREFERENCE OF LOW 
INCOME GROUPS FOR SMALL 
STATIONS 


ALVIN MEYROWITZ anp MARJORIE FISKE 
Princeton Radio Research Project 


N a study of listening habits made for the Princeton Radio 
Research Project, it was found that the usual check-ups on 
listening made by commercial agencies for the big networks 

show that listening increases steadily from A to C groups, but 
then drops for the D groups. It was inferred therefrom that 
the D groups might possibly listen more to smaller stations." 
There have been incidental observations which seemed to cor- 
roborate this assumption. Merchants selling low-priced mer- 
chandise, and credit-store merchants in the metropolitan area, 
for example, claim that they reach their public better over 
small stations, and would use them even if they could afford 
to advertise over the big stations. However, there was no 
direct statistical evidence on this entire question, which, as will 
be shown later, may have great psychological importance. The 
writers of this report, therefore, sifted through various statis- 
tical data for material to resolve the question. Finally two 
groups of data were found which shed considerable light on the 
question of who listens to small stations. 

One of the big networks made a survey in 1937, asking many 
thousands of people the following question by means of personal 
interviews : ‘‘When you and your family use your radio during 
the DAYTIME (before sunset) what radio stations do you 
generally listen to?’’ From this survey the 1669 who had been 
interviewed in the metropolitan area in and around New York 
were selected for special analysis. The stations mentioned by 
the respondents were divided into network (large) stations 
and local (small) stations; the network stations consisted of 

1 The idea that lower income groups ave more likely than other parts of 
the population to listen to small stations has been suggested by H. M. 
Beville (National Broadcasting Company), who conducted this study. 
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WABC, WEAF, WJZ and WOR, while there were 21 smail 
stations mentioned. 

The respondents were divided into three economic groups, 
A (high), B (middle), and C (low). This information was 
taken from the punch cards which the network placed at our 
disposal. The economic groups were originally ascertained 
according to the usual standards of market research, using the 
place of residence of the respondent and the ownership of car, 
radio, and similar items as criteria for economic status. 

In each of the three economic groups the proportion of small 
stations to all stations mentioned was then computed. The 
following table gives the results: 


TABLE 1 


Relation Between Economic Status and Proportion of Small and Large 
Stations Listened to Regularly 








Economic Proportion of |§_Proportionof | Number of 

group small stations large stations respondents 
Group A. ........ Siew 9.5% 90.5% 387 
Group Bo oun 14.2% 85.8% 726 
Group CO oncccmum 18.2% 81.8% 556 





The table shows quite clearly that as economic level decreases 
the proportion of small stations listened to regularly increases.” 

The set of data used so far dealt with stations as a unit. It 
might'still be, however, that although the lower income groups 
listen to more small stations, they do not spend more time lis- 
tening to them than to large stations. It is fortunate, therefore, 
that the other set of data available deals with amount of listen- 
ing. Market Analysts, Inc., made a study at the New Jersey 
State Fair of Trenton where 675 visitors were asked the follow- 
ing two questions, among others: ‘‘On an average, how many 


2 Those figures pertain to daytime listening. The very laborious work 
necessary to arrive at this result made it necessary to confine ourselves 
vither to daytime listening or to evening listening. It seemed advisable 
to take the daytime figures because many of the small stations do not 
broadcast during the evening. 
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hours per day is your radio turned on? Of this listening time, 
about what part is to local stations?’’ The answers to these 














questions were then tabulated by income groups: 
TABLE 2 
Distribution of Local Station Listening According to Income 
Level of Respondent 
of total Income level 
doretet te end Total 
stations 0-1999 2000-3999 4000 & over 
pS AS ee 36.9% 47.7% 51.8% 42.5% 
. it os aa 33.1 28.9 25.0 30.7 
2 and over .......... 30.0 23.4 23.2 26.8 
Total per cent 100.0 100.0 100.0 100.0 
Total no. .......... 330 217 73 620 





Here again it can be seen that the greater is the proportion 
of listening-time spent on local stations, the lower is the income 
level.* 

8It is interesting to see that the differences in small-station listening 
becomes still greater if the respondents are classified by educational level, 
as the following table shows: 


TABLE 3 
Amount of Local-Station Listening Distributed According to 
Educational Level of Respondent 














of total Educational level 
1+ yrs. 1-4 yrs. Total 
devoted to local 8th grade 
high coll., adv. 
stations and under oak degree 
TEU Laine his 24.0% 41.3% 57.5% 41.9% 
Up to? ........ 38.4 30.3 26.9 30.0 
Zand over... 42.6 28.4 15.6 28.1 
Total per cent 100.0 100.0 100.0 100.0 
Total no. ........... 150 328 164 642 





The distinct relationship between educational level and small-station 
listening should finally prove very important when it comes fo the inter- 
pretation of the whole phenomenon. This report, however, is restricted 
to the economic factor. 
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These two sources of information, although restricted to 
relatively small areas, strongly corroborated the assumption 
that ‘‘the little fellow likes the little station.’’ The real im- 
portance of the question comes to the foreground only when we 
interpret the result. 

There are three possibilities: (1) The lower income groups 
do not have good radio sets, and it is easier for them to receive 
the small stations than the big ones. (2) Among the lower 
income groups there are likely to be more foreign-born people 
who would be interested in stations broadcasting the language 
of their native countries. These programs are broadcast only 
over small stations and would account for the preference for 
small stations among the lower income groups. (3) Psycho- 
logically, these small stations may be more adequate for the 
lower socio-economic groups, for two supplementary reasons: 


(a) The small stations definitely have a local appeal. The 
listener hears advertisers with whom he is familiar, or with 
whom he has contact. He hears names and addresses of people 
in nearby areas, whom he may know. He may even telephone 
the station and suggest a musical selection himself, and hear 
his own name mentioned. This is very much the atmosphere 
of the poor neighborhoods where there is still more personal 
contact between people than in the wealthier, more deperson- 
alized districts. 

(b) The appeal of the large station is very often the appeal 
of New York and Hollywood. The individuals are socially and 
physically remote, the places are remote, and the process of 
identification is more complicated than when confined to local 
areas. The psychological universe of the lower income groups 
is, of necessity, confined to a socially and geographically re- 
stricted area. They may feel an element of strangeness in the 
remote psychological range of the large stations just as much as 
they may find greater appeal in the restricted and perhaps 
familiar realm of the small stations. 


Our data permit, rather safely, an elimination of possibility 
(1). Both studies were made in an area where the big stations 
can be heard as well as the small oaes on any radio set. This 
point has been checked with experts in the field of station 
coverage. 
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Interpretation (2) is certainly a factor. There is much 
evidence that foreign-born working people listen to foreign- 
language broadcasts, and these broadcasts are heard only over 
small stations.* 

The question then remains whether, beyond this factor of 
foreign language, there is a psychological bond between low 
economic status and the kind of programs small stations offer. 
A final answer is possible only if data similar to the data of 
this study can be collected separately for native-born and for- 
eign-born. The writers of this report were present when 
the interviews in Trenton were made, and they feel confident 
that there were very few foreigners among the respondents. 
This fact restricts the language-appeal factor. On the other 
hand, there is evidence from other studies that would support 
the psychological interpretation of our result. Beville, in the 
study mentioned earlier, found that such programs as Major 
Bowes’ Amateur Hour have a greater appeal for the lower 
income groups as compared with the higher ones. Robinson, 
in a study done jointly for the Columbia Broadcasting System 
and the Princeton Radio Research Project, found small farmers 
preferring ‘‘folksy’’ programs like barn dances and local Bible 
hours. Lazarsfeld, in a study made in 1930 for the Austrian 
Radio System, found great dislike of jazz among the working 
population. It seems not unlikely that the simple instruments 
used on the programs of the small stations, and the simpler 
language of some of their announcers, appeal to the lower 
income groups more than the glamor and richness of many 
of the big network programs. 

Radio as a medium of escape has received much attention 
from psychologists and psychoanalysts. If further study of 
this problem shows a marked difference in listening tastes for 
different socio-economic groups, it may be found that there are 
psychological distances beyond which the processes of imagina- 
tion, identification, or escape cannot function. 

4A special study of this question is now being conducted by the New 


Jersey Federal Writers Project, in cooperation with the Princeton Radic 
Research Project. 
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RADIO AMONG THE UNEMPLOYED 


FRANCES HOLTER 
Princeton Radio Research Project 


HE following report is based upon incidental communica- 

t tions gained from unemployed families. Such observa- 
tions have an advantage over systematic research, inas- 

much as they sometimes spring from quite unusual situations 
which are psychologically more revealing than any artificially 
created circumstances could be. On the other hand, such inci- 
dental observations are more subject to the bias of the observer 
than if he were checked by a well-controlled experimental setup. 

It is very fortunate, therefore, that the material to which we 
refer has been collected without any reference to radio prob- 
lems. In 1935 the International Institute for Social Research 
gathered the material for a study on the changes in paternal 
authority brought about by the unemployment of the head of the 
family. Elaborate case studies were made, dealing with 
changes in the attitudes and habits of all the family members 
which might be indicative of a change in the authoritarian struc- 
ture of each family under investigation. Radio came into the 
discussion only when it was a matter of conflict between father 
and children, or when one of the respondents voluntarily men- 
tioned experiences which he felt should be exemplified by inci- 
dents related to radio listening. None of the students working 
on this study had any connection with radio as a problem of 
research. 

Three years after the unemployment study was finished, it 
occurred to this writer to look over the old records to see whether 
any reference to radio was made at that time. To our surprise 
they were quite frequent, and they are reported here as sug- 
gestions for further research. None of these incidental remarks 
is conclusive, but they furnish a number of hunches which seem 
worthwhile to be followed up by other students for closer 
scrutiny. 
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The remarks reported by the people covered in the original 
study can be divided into those which express the importance of 
radio for members of an unemployed family as long as they have 
a radio, and those which pertain to the consequences of the loss 
of radio in the course of financial deterioration. 

It was found among these unemployed families where all 
outside activities such as church-going, movies, entertaining, 
clubs, and visits had been curtailed, that the radio assumed tre- 
mendous importance as the chief recreation of the family group. 
Remarks like the following are frequent : 

**The radio is going practically all day. It is our only recrea- 
tion.’’ 
‘*The whole family likes the radio. I don’t know what we would 


do without it, we would go crazy. It keeps us in touch with the out- 
side world.’’ 

‘*The radio is the cheapest and best amusement we can get.’’ 

**If you took the radio away from him (the ten-year-old son) it 
would be like taking away his meal.’’ 

**Tf we lost the radio, I’d be willing to dig my own grave.’’ 

**Tf the radio were ever taken away from the children they would 
be lost, because that is their main hobby.’’ 


It might be characteristic for the plight of these people that 
the majority of the remarks are given in a form which antici- 
pates further blows: ‘‘If the radio were taken away .. .”’ 

Besides its direct importance for the family as a main source 
of recreation, the radio performs various services for individual 
family members. One mother said that she would not give up 
the radio under any circumstances because if the radio went her 
daughter would be unable to entertain her friends in her home. 
It seems that in some of these families the radio was essential for 
the young people’s social life, to enable young women to invite 
their boy-friends and girl-friends in to dance, to learn the 
popular songs, to keep up with their group. This need for the 
radio as a social tool was recognized and expressed by the 
parents. 

The radio was also found to function as a means of parental 
control. Parents stated that it was an aid to them in various 
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matters of child routine and child discipline. As a bait, it 
lured the children home and off the streets early and children 
could be maneuvered into bed on time if they could ‘‘listen in 
bed.’’ One mother said that the radio was a great help in main- 
taining discipline because, whenever the children were naughty, 
she punished them by not letting them use the radio. For par- 
ents with little else to withhold from their children, the radio 
thus became an important support for their authority. 

It is therefore not surprising to find, when parents were 
forced to sell their radios, that family living was subjected to a 
strain that had many repercussions. It seems that the loss of 
the radio drives home to the children the impact of the depres- 
sion much more than any other factors which might be of 
greater importance from the adult point of view." 

One woman tells that the children miss the radio a great deal 
and often talk to the father about ‘‘how nice it would be if the 
family had a radio and could listen to the various broadcasts.”’’ 
The husband contends that this aspect of the depression has 
made things very uncomfortable because the children were 
always used to a radio and then suddenly were forced to do 
without one. They do not complain, but ‘‘feel bad about it 
anyway, wouldn’t you?’’ 

In another family the loss of the radio made the father espe- 
cially aware of his failure to realize his réle as provider. 

‘* Whenever the children started crying because there was no radio 


in the house I felt bad as hell to think that I had to sell the one thing 
that was giving them so much pleasure.’’ 


One father, who thought his children sometimes wondered 
why, when all their friends had radios, they didn’t have one, 
said : 

1In the original study to be published by the International Institute 
for Social Research, it was found that young children are not so much 
affected by the unemployment of the father, and even enjoy his increased 
company as long as he can maintain his own morale. The loss of radio, 
then, seems to be one of those channels through which the father’s unem- 
ployment weighs directly upon the children’s lives. 
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**Once I overheard Peter say to Dave that it would be a great 
thing if the family had a radio. Dave answered that they would 
have to wait till their father went back to work before this could 
happen. It may not mean anything to you, but it made me feel just 
as if I am going to waste. . . . I would give anything if I could buy 
them a small radio.’’ 

In some depression-strained families the loss of the radio pre- 
cipitated open conflicts. The following is taken from an inter- 
viewer’s account of a father’s difficulties: 

‘*When they had to sell the radio to pay the milk bill, many 
troubles arose. The eighteen-year-old daughter missed the radio more 
than anyone else in the family because she listened to it most and 
some evenings she invited friends in to dance. When it was first 
taken out, she complained that she was ashamed to bring anyone up 
to her home because they didn’t have a radio. She started meeting 
her boy-friends on the street against her parents’ wishes. She had 
constant arguments with her father and finally she told her mother 
that she was disgusted with her family because it couldn’t give her 
half the things other girls were able to have.’’ 


Obviously there were factors other than loss of radio in the 
development of this family crisis, but according to the parents, 
the sale of the radio inaugurated their daughter’s open rebel- 
lion. 

A similar tendency toward an exodus of children from radio- 
less homes was evident in quite a number of cases, although not 
always in such an extreme form. One mother of young chil- 
dren says, 

**Now that the children do not have the radio to console them they 
: sometimes cry and want to go next door to listen.’’ 

A nine-year-old boy said that he could remember the time 
when his family had ‘‘a real good radio.’’ He enjoyed it tre- 
mendously and is sorry they don’t have one now. So now when 
he comes home from school he goes over to his grandmother’s 
house to listen, The grandmother brings him home at seven 
o’clock. His mother said that she did not like this custom for | 
‘*many reasons, none in particular.’’ Older girls, whose fami- 
lies had been forced to sell their radio, stopped asking their 
friends in to dance and went to their friends’ houses instead. 
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It seems that some children do not easily accept this shift from 
listening at home to listening outside. An excerpt from an 
interview with a thirteen-year-old boy illustrates the child’s 
feelings of loss of family status involved in the situation of hav- 
ing to listen to a friend’s radio. 

‘*When his family sold the radio the boy felt ‘lost’ and couldn’t 
wait for the day when his family would again have a radio. During 
this period he went to the homes of his friends and listened to his 
favorite broadcasts. He didn’t like to do this because his friends 
used to make him feel ‘cheap’ with their remarks about his family 
not owning a radio. They used to say, ‘Aren’t you sorry that you 
don’t have a radio?’ or ‘Why don’t your father buy you a radio?’ ’’ 

Since an uncle presented this family with a small radio, 

‘*The children are very happy about it. They go around telling 
all their friends that they too have a radio.’’ 

A remark made by the daughter (age 9) to her father, when the 
new radio was brought home, reveals how acutely the radio sym- 
bolized status to her : 


** Now we’re as good as our friends.’’ 


Another mother of a thirteen-year-old daughter said, 

**Now that we don’t have the radio the kid sometimes goes over 
to one of her friend’s houses and listens to their radio. She don’t 
like to go there always, because, you know how it is, she feels sort of 
ashamed. ’’ 

The girl herself said the same thing: 

‘*It makes me feel funny when my friends’ parents ask me whether 
or not we have a radio at home.’’ 

In a number of cases the parents forbade the children to listen 
to the radio elsewhere for the sake of keeping face. Then the 
whole question becomes a typical matter of conflicts arising as 
a consequence of unemployment. 

Of course sometimes the loss of the radio works the other way 
around. It is by now a fairly well established fact that unem- 
ployment is likely to increase the troubles of disorganized 
families. But it may strengthen, at least in the beginning, the 

2P. Eisenberg and P. F. Lazarsfeld, ‘‘The Psychological Effects of 
Unemployment,’’ Psychological Bulletin, 1938. 
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mutual understancing of well-integrated families. This seems 
to be true also as far as the loss of radio goes. 

In some cases members were able to adjust to the loss of their 
usual mode of recreation by entering into some compensatory 
activity, as in the case of the father who previously spent his 
leisure listening to the radio and who now makes toys for his 
children in his spare time. In another family where the par- 
ents were greatly disturbed because the children missed the 
radio so much, the children undertook to entertain their family. 
Now, in the evenings, the daughter (age 14) tells her mother 
and father to sit down and forget their troubles while she and 
her brother (age 12) sing American and Italian songs to them. 

For a more systematic study the problem would come up as 
to what kind of evidence should be collected to validate these 
incidental observations. In addition to getting more case studies 
directed toward the meaning of radio for the unemployed, 
a number of inferential indices might be used. It is told, for 
instance, that home-relief agents have difficulty in keeping relief 
clients inside the limits of their electric-bill allowance because 
they hate to reduce the time their radios are turned on. It 
should not be difficult to get evidence on that score by contacting 
responsible agencies. Then there are studies probably avail- 
able, or studies which could be made, as to the order in which 
unemployed people dispose of their belongings before they go 
on relief; the rank order of radio in comparison with other pos- 
sessions sold or pawned should be indicative. Still more light 
could be thrown on the subject if studies were made with newly 
re-employed people, to find out the order of regaining their be- 
longings. It might well be that radio has a different position 
compared to other objects at the begining and at the end of a 
period of unemployment. Special objects could be selected for 
more detailed comparison, such as the loss of the last watch or 
clock, for instance, forcing the family to ask other people for the 
time. 

In families where the radio has gone it would be revealing to 
know what substitute activities the different members of the 
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family show, and what factors may account for their different 
choices. It might be especially interesting to compare state- 
ments of the unemployed who still have a radio regarding what 
they would do if it were lost, with what another group does 
when their radios have disappeared already. A further ques- 
tion would be whether unemployed people shift their program 
preferences as time goes on.° 

Further, exact studies should be made about the mere amount 
of listening among the unemployed. It could be, for instance, 
that the unemployed man listens more and more whereas his 
wife listens less than she did when he was employed because her 
work does not decrease but her responsibilities increase in times 
of stress. Finally, it would be important to know what effect 
radio has upon an unemployed man’s efforts at rehabilitation ; 
is it more likely to have a kind of doping influence which inter- 
feres with his job-hunting activities, or will it be rather a com- 
fort whch improves his efforts? This communication is meant 
to show that here there are a number of problems waiting for 
investigation. 

8 This suggestion has already been made by Cantril and Allport, in their 
Psychology of Radio. 




















Section V. Reports of Other Surveys 


Editorial: The content of this section should prove useful to 
students who intend to do radio research of their own. A sur- 
vey of available material and studies in progress will help to 
avoid duplication and give leads as to which special problems 
might well fit into the whole field. 


FACTORS INVOLVED IN 
“GOING ON THE ATR” 


FRANK STANTON 
Director of Research, Columbia Broadcasting System 


Editorial Note: Dr. Stanton, along with Dr. Hadley Cantril of 
Princeton University, is an Associate Director of the Prince- 
ton Radio Research Project. 


social scientist generally has a choice between two 
kinds of material. He may collect his own data, in which 
case they will be oriented with reference to his individual 
problems, but as academic work usually goes, not very abundant. 
The excessive cost of collecting social data for special problems 
is indeed a handicap to the progress of the social scientist. On 
the other hand, the administrative needs of business and govern- 
ment produce quantities of statistical material which probably 
could be utilized for other scientific purposes if only students in 
related fields would scrutinize the data from their own points of 
view. In some fields, for example, professional societies and 
business organizations have watched for the emergence of new 
data with subsequent evaluation and application to problems 
of their own interest. Similar opportunities exist in the field 
of radio. 
1 For example, see the report of Dorothy 8. Thomas, ‘‘Some Possibilities 
of Utilizing Social Security Data for Sociological Research Projects.’’ 
170 
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The successful administration of broadcasting in the United 
States makes it necessary to collect large amounts of listener 
data, year after year. These data, amassed for the purpose of 
an intelligent use of radio in connection with the three broad 
problems of station coverage, program preferences, and audi- 





Report delivered before the American Statistical Association, Atlantic 
City, N. J., December 29, 1937. 

For further instances of re-examination of government statistics see, 
Columbia Broadcasting System, Inc., Vertical Study of Radio Ownership, 
1930-1933. New York: Columbia Broadcasting System, Inc., 1933. 52 
pp. Based on a complete cross-tabulation of 13,753,073 U. 8. Family 
Records for the Columbia Broadcasting System by the United States 
Department of Commerce, Bureau of Census. 

Columbia Broadcasting System, Inc., Markets in Radio Homes by In- 
come Levels and Price Levels. New York: Columbia Broadcasting Sys- 
tem, Inc., June, 1934. 60 pp. 

The Curtis Publishing Company, U. 8. Conswmer Purchase Survey: Se- 
lective Spending in Chicago—Providence—Denver. Philadelphia: The Cur- 
tis Publishing Company, April, 1938. 32 pp. Mimeographed. 

The Curtis Publishing Company, Consumption by Rural Families Versus 
Sales in Rural Places: A Study of Nine Counties in Iowa and Illinois 
Based on the Study of Conswmer Purchases of the Bureau of Labor Sta- 
tistics. Philadelphia: The Ourtis Publishing Company, July, 1938. 18 
pp. Mimeographed. 

The Curtis Publishing Company, Market Dubiese in Eight Large Cities: 
Based on the Study of Conswmer Purchases of the Bureau of Labor Sta- 
tistics. Philadelphia: The Curtis Publishing Company, August, 1938. 32 
pp. Mimeographed. 

MacFadden Publications, Inc., Family Incomes and Expenditures: 376 
Cities Over 25,000 Population. New York: MacFadden Publications, Inc., 
1938. 26 pp. Developed from the Study of Consumer Purchases of the 
Bureau of Labor Statistics. 

Samuel A. Stouffer and Paul F. Lazarsfeld, Research Memorandum on 
the Family in the Depression. New York: Social Science Research Coun- 
cil, 1937. 208 pp. 

Time, Inc., A Study of Family Expenditures by Incomes. New York: 
Time, Inc., September, 1938. 25 pp. 

Roland 8. Vaille, Research Memorandum on Social Aspects of Consump- 
tion in the Depression. New York: Social Science Research Council, 1937. 
80 pp. 
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ence availability, may throw light on problems other than those 


for which they were collected originally. In certain instances 
the social scientist may see new uses to which these materials 
ean be put. The writer feels confident that few other activities 
have as much quantitative data concerning themselves available 
for examination. No other field of entertainment or advertis- 
ing has kept as complete a ‘‘log’’ of its influences. 

To present a brief outline to the social scientists of some of the 
things known regarding the radio audience and the use which 
the advertisers make of these data, this article is organized 
around the steps taken by a radio sponsor once he has decided 
to ‘‘go on the air.’’ It remains for each applied scientist to 
visualize the possibilities of the data for his own problems. 


THE SELECTION OF STATIONS 


Assuming comparable time periods are available on more than 
one network, the first consideration of the radio advertiser in 
the selection of stations is their geographic coverage in relation 
to his sales distribution. From the lists of stations available 
and information on their coverage the advertiser selects the net- 
work of stations which best serves his particular markets. 

On the question of coverage there are two points of view:* 
One is that held chiefly by the engineers and is concerned solely 
with where a station delivers a signal of a given standard. Ina 
sense such measurements reflect only the potential coverage of 
a station—the areas where the station can be heard.* The other 
viewpoint, the one in which the broadcaster and advertiser are 
most interested, is concerned with where the station actually is 
listened to. It is on the second approach—where listeners tune 

2 For a discussion of this topic see, L. D. H. Weld, ‘‘The Problem of 
Measuring Radio Coverage,’’ Journal of The American Statistical Asso- 
ciation, XX XIII, 201 (March, 1938), pp. 117-125. 

8 The Federal Communications Commission’s allocation of broadcasting 
facilities is based on such measurements. A regular field service reporting 
data on station signal strength is that issued by Edgar A. Felix, Radio 
Coverage Reports, 7 West 44th Street, New Yorx, New York. 
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to the station—that the major networks base their coverage 
analyses.* 

Currently the coverage maps of the Columbia Broadcasting 
System and the Red and Blue Networks of the National Lroad- 
casting Company are based on listener mail response. In the 
ease of NBC it is the accumulated mail of six months to two 
years to all programs, while with CBS it is the relatively 
instantaneous audience mail response to a special ‘‘listening 
study’’ offer made during a typical week. The individual sta- 
tion coverage maps for CBS are computed, day and night 
separately, as follows: The mail response to the specific offer 
(which has no intrinsic value) is tabulated by county of origina- 
tion and for each county the response per 1,000 families is cal- 
culated. The response per 1,000 families in the station’s home 
county is taken as 100 per cent since the station’s maximum sig- 
nal is delivered in its home county. The intensity of coverage 
in any other county is obtained by expressing its response per 
1,000 families as a per cent of the response per 1,000 families in 
the home county. Thus in each county the intensity of coverage 
is measured in relation to the intensity of coverage in the sta- 
tion’s home county.’ A station’s ‘‘primary area’’ includes all 
counties having a response ratio of 25 per cent or more of the 
station’s home county. 

In an effort to make the geographic coverage information 
more useful, market data for the areas delineated by the mail 
response ratios, or the engineers’ ‘‘signal strength’’ measure- 
ments, are computed for the advertiser’s ready reference. 
These market data, summarized by counties, are obtained from 


#For complete discussions of techniques and findings see, Columbia 
Broadcasting System, Inc., CBS Listeners and Dealers. New York: 
Columbia Broadcasting System, Inc., 1938. I, Evening, 239 pp. II, Day- 
time, 243 pp. 

National Broadcasting Company, Inc., NBC Network Areas. New 
York: National Broadcasting Company, Inc., 1935. 31 pp. 

5 In the technique followed by NBO, its coverage is based on the mail 


response of each county in relation to engineering measurements and not 
the station home county. 
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standard statistical sources, including the U. S. Census of 
Population, Census of Business, and the like. To give an idea 
of station coverage data, on the next two pages are tabular and 
graphic analyses of the coverage of Station WEEI, Boston, 
Massachusetts. 
TABLE I 
Market Data: Daytime Listening Areas® 





WEEI, Boston—5,000 watts—590 ke. 













































































Seco 
Market Data = ew 

Number of Counties 32 25 
Total Population 4,927,500 2,393,500 

Urban Population 4,058,600 1,682,300 

Rural Population 868,900 711,200 
Total Families 1,211,200 587,200 
Radio Families 1,097,120 545,570 
Radio Listeners 4,123,570 2,038,320 
Passenger Automobiles 788,489 428,465 
Residence Telephones 551,692 251,283 
Electric Wired Homes 1,195,850 559,490 
Domestic Gas Customers 782,330 325,130 
Total Retail Outlets 63,761 31,633 
Total Retail Sales $1,588,561,000 $730,006,000 
Total Food Stores 23,790 10,926 
Total Food Sales $ 490,845,000 $214,098,000 
Total Drug Stores 2,201 1,069 
Total Drug Sales $ 53,399,000  $ 25,075,000 
Automotive Dealers 4,504 2,340 
Automotive Sales $ 175,232,000 $$ 96,835,000 
Filling Stations 5,853 3,493 
Filling Station Sales $ 74,504,000  § 37,046,000 
Apparel Stores 4,924 2,226 
Apparel Sales $ 136,653,000 $ 61,010,000 
Furniture & Household Stores .................... é 1,971 943 
Furniture & Household Sales ............... ue @ 58,001,000 $ 29,123,000 
Lumber, Building, Hardware Outlets .... 2,093 1,097 
Lumber, Building, Hardware Sales ....... $ 62,570,000 $ 33,618,000 
General Merchandise Stores -cccccccmeo- 2,854 1,431 
General Merchandise Sales ..............__ $ 212,922,000  $ 99,582,000 





¢ Columbia Broadcasting System, Inc., CBS Listeners and Dealers, II. 
New York: Columbia Broadcasting System, Inc., 1938, p. 28. 
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Ficure 1. Daytime Listening Areas.? WEEI, Boston 
7 Op. cit., p. 29. 
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Other current methods of measuring station coverage involve 
personal interviews and the use of automatic recording devices 
which reveal station tuning habits.® 

In the case of personal interviews, investigators are sent out 
into the general area served by the station to make representa- 
tive house-to-house calls to determine what stations the listeners 
use regularly, day and night.* The area in which the interviews 
are conducted is extended from the station until listening to the 
station falls below a prescribed level. The automatic recording 
devices if distributed over a wide area for a period of time will 
produce the same results as the personal interviews with less 
chances for error, both on the part of the investigator and 
respondent. 

Station coverage, since it is a matter of relating one county 
to remaining counties, is not the only factor to be considered in 
selecting stations. In addition, ‘‘station penetration’’ is con- 
sidered. By this is meant the popularity of the station under 
consideration in relation to other stations serving the same 
market. Information on station popularity is obtained in 
several ways.*° Any survey obtaining information on the sta- 

8 For a discussion of the automatic recording device see, Broadcasting, 
‘¢ Mechanical Survey Brings Surprises,’’ Broadcasting, X, 2 (January 15, 
1936), pp. 9, 54. 

Lester B. Colby, ‘‘Nielsen’s Radio ‘Audit’: What It Will Reveal About 
Listering Habits,’’ Sales Management, XLIII, 3 (August 1, 1938), pp. 32, 

74, 75. 
yp F. Elder, ‘‘ Measuring Station Coverage Mechanically,’’ Broad- 
casting, IX, 11 (December 1, 1935), pp. 11, 59. 

Robert F. Elder, ‘‘And Now Science Meters the Radio Audience,’’ 
Broadcasting, X,5 (March 1, 1936), pp. 7, 58. 

Robert F. Elder, ‘‘A New Type of Radio Coverage Research,’’ American 
Marketing Journal, III, 1 (January, 1936), pp. 41-46. 

Frank N. Stanton, ‘‘ Checking the Checkers,’’ Advertising and Selling, 
XXVI, 4 (December 19, 1985), pp. 24, 44. 

® Coverage studies should distinguish between day and night habits of 
listening because many stations operate with a lower power after sunset; 
also because signal propagation characteristics change at sunset. 

10 Columbia Broadcasting System, Inc., Price-Waterhouse Audits of Sta- 
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tions listened to by periods of the day will produce answers on 
station popularity. Questions can also be asked regarding sta- 
tions listened to ‘‘most,’’ ‘‘regularly,’’ and ‘‘occasionally.’’ A 
summary of a representative group of replies to such items will 
reveal the station which best penetrates the market. 

Surveys designed for other purposes may yield information 
on popularity. For example, the personal interview and re- 
corder techniques already mentioned will yield both coverage 
and penetration analyses. One of the advantages of this type 
of study is that data are obtained simultaneously on all stations 
serving the area. 

THE CHOICE OF A PROGRAM 

Once having decided on a network of stations, the advertiser 
has next to decide on a program. This decision depends on the 
audience the advertiser wishes to reach and the time of his 
broadcast. Since the time of the broadcast will be considered 
below, attention here will be directed toward program content. 
It should be recognized, however, that these two problems can 
not be divorced. 

In connection with program content the prospective adver- 
tiser has considerable information on which to draw from two 
general sources. The first is the material on program prefer- 
ences ;* the second, the results of systematic studies of actual 
tion Popularity and Audience Size. New York: Columbia Broadcasting 
System, Inc., 1931, 1932, 1933, 1934, 1935. 

Columbia Broadcasting System, Inc., Station Audiences in Urban Mar- 
kets. New York: Columbia Broadcasting System, Inc., April, 1937. 
Unpublished findings based on 20,000 personal interviews. Field work 
conducted by Dr. Daniel Starch and Staff. 

Cooperative Analysis of Broadcasting, Station Audiences. New York: 
Cooperative Analysis of Broadcasting, October, 1935-April, 1936; October, 
1936—April, 1937; October, 1937-April, 1938. 

11 For a summary of this material see, Isabelle F. Wagner, ‘‘ Program 
Preferences of Different Groups,’’ Journal of Applied Psychology, 
XXIII, 1 (February, 1939), pp. 187-192. 

Also see Fortune Quarterly Survey: XI, Fortune, XVII, 1 (January, 
1938), pp. 83, 84, 86, 88, 91, 92. 

World Telegram 1939 Radio Poll, New York World-Telegram, LXXI, 
183 (February 4, 1939), pp. 10, 11. 
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program listening.* The latter sources of information are per- 
haps the more reliable for they reflect what people actually 
listen to during the current radio day as against what people 
would like to listen to. 

There are numerous techniques for determining actual listen- 
ing habits, all with advantages and disadvantages too numerous 
to list here.** It is sufficient to report that the two current ser- 
vices in this field use telephone interviews to determine program 
listening. One service interviews the listener regarding his 
listening over a four-hour period prior to the call, while the 
other makes inquiry regarding the listening, if any, at the time 
of the call and also asks regarding listening during the quarter- 
hour prior to the call. Below, Table II, are the ten most 
popular programs as rated by one of the services, The Coopera- 
tive Analysis of Broadcasting, for the period ending January 
24, 1939.** 

12 The two main services in this field are the Cooperative Analysis of 
Broadcasting, 330 West 42nd Street, New York, New York, and C. EZ. 
Hooper Radio Reports, 51 East 42nd Street, New York, New York. 

18 For a discussion of the various techniques for measuring the radio 
audience see, Frederick H. Lumley, Measurement in Radio. Columbus, 
Ohio: The Ohio State University, 1934. 318 pp. 

John J. Karol, ‘‘Measuring Radio Audiences,’’ Printers Ink Weekly, 
CLXXVII, (November 19, 1936), pp. 44, 48, 52, 56. 

Frank N. Stanton, A Critique of Present Methods and a New Plan 
for Studying Radio Listening Behavior. Columbus, Ohio: Ohio State 
University Library, 1935. 244 pp. The writer is currently preparing a 
special monograph on the subject for the Princeton Radio Research 
Project. 

Editorial Note: H. M. Beville, Jr., Chief Statistician of the National 
Broadcasting Company, has made a detailed analysis of these ‘‘ program 
ratings’’ for the Princeton Radio Research Project. He studied espe- 
cially differences in listening habits between social groups, regions of 
the country, and the influence of factors like competing programs and 
time of day on success and failure of typical programs. These results 
will be published shortly. 

14 From CAB Report, IX, 21, for the period ending January 24, 1939. 
Data given with the permission of the Cooperative Analysis of Broad- 
casting. 
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While a thorough knowledge of general program preferences 
and current listening habits is helpful, the advertiser in select- 
ing a program must consider other things as well. Current 
preferences are usually examined in the light of program 
trends.** For example, in Table III are the overall trends of 
two types of programs, drama and popular singers, based on 
semi-annual summaries of CAB ratings.*° In the case of 
drama, the average audience rating has climbed steadily over 
the last three years, while with popular singers the average has 
declined. 

TABLE III 
Audience Trends: 1935-1938 





October, 1935- October, 1936- October, 1937- 
Programtype September, 19386 September, 1937 September, 1938 


ee 7.6%* 8.6% 9.6% 
Popular singers ........... 3.2% 2.2% 19% 








* Average audience ratings for all drama and popular singer programs. 
100% = Total radio families interviewed. 


In addition to the average rating and trend, one must also 
consider the number of programs of one type currently on the 
air. For example, if there were an abundance of news pro- 
grams being broadcast and that type of program were highly 
preferred, it might be very ineffective to add another, unless it 
had some unique quality. 

The remaining factors regarding the program content are 
related to the hour of the broadcast and the product or service 
offered. In the interests of program balance, consideration is 
generally given to programs which will be broadcast before and 

15 For a discussion of program trends see, A. W. Lehman, ‘‘ Program 
Popularity in 1938,’’ Broadcasting 1939 Year Book, XVI, 3-A (Feb- 
ruary 1, 1939), pp. 30, 22, 33. 

16 The Cooperative Analysis of Broadcasting, Radio Program Audi- 
ences, New York: Cooperative Analysis of Broadcasting, October, 1935- 
April, 1936; May-—September, 1936; October, 1936—April, 1937; May- 
September, 1937; October, 1937-April, 1938; May—September, 1938. 
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after, and even during the period (i.e., on other stations) to be 
occupied by the new program. 

In connection with planning the program’s content, the mood 
of the day and hour are considered in some detail. Light music, 
rather than mystery programs, fits the dinner hour. While 
research analyses are available on this point for guidance, from 
CAB and Hooper Reports, the problem is generally solved with 
a reasonable amount of common sense. 


THE TIME OF THE BROADCAST 


Coupled with the program problem is the task of selecting a 
suitable time for broadcasting. The timing of the program in 
the broadcast day is very important psychologically and a prob- 
lem on which there is considerable material for the advertiser’s 
use. The first step is to determine the general living and pur- 
chasing habits of the consumer to be reached and to key or time 
the program to fit into the listener’s ‘‘psychological’’ shopping 
pattern at the point where it will be most effective. 

One survey*’ in 16 cities asked housewives what day of the 
week they preferred to do their downtown shopping. Monday 
was mentioned by 15.5%, Tuesday 8.6%, Wednesday 15.5%, 
Thursday 10.9%, Friday 13.0%, and Saturday 36.5%. Obvi- 
ously, such data are important for department store advertisers. 
Other advertisers have different problems: Gasoline advertisers 
want, in general, to reach the entire family just before the 
week end, while soap manufacturers want to reach the housewife 
in the daytime before she buys or orders her supplies from the 
local grocer. 

Buying-traffic data on which these generalizations are based 
usually are common knowledge to the advertiser. If not, the 
data can be assembled shortly by examining company distribu- 


17 Scripps-Howard Newspapers, Market Records: Buying Habits and 
Brand Preferences of Conswmers in £ cteen Cities. New York: Scripps- 
Howard Newspapers, 1938. I, 323 pp. II, 339 pp. 

Scripps-Howard Newspapers, Market Records: The Siateen City Com- 
parative Retail Supplement. New York. Scripps-Howard Newspapers, 
February, 1938. 55 pp. 
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tion records. Once the advertiser fixes the general period when 
he wants to apply the broadcast-buying-stimulus he can turn to 
audience data to determine the exact time period for his pro- 
gram. 

The next step in the selection of time is to determine whether 
the consumers whom the advertiser wants to reach are actually 
at home during the periods under consideration. Data on the 
availability of the entire family by sex and age groups exist for 
the four quarters of 1938, based on some 40,000 urban inter- 
views.** Similar data are available for rural families.*® 

In order to show the differences in the availability of various 
members of the family during the day, Table IV shows four 
half-hour periods for the average week-day (Monday through 
Friday). The figures are coast-to-coast averages and show the 
per cent of the urban radio families with any man, any woman, 
adolescents or children ‘‘at home and awake’’ during the spring 
quarter study of 1938. It is self-evident from Table IV that 


TABLE IV 
Urban Radio Family Availability 
** At Home and Awake’’ 
Monday-Friday, coast-to-coast averages 








Eastern Any Adoles- 
Standard Time Anyman = woman cents Children 
10: 00-10: 30 a.m. ............ 23.1% 80.1%* 4.8%* 7.6%* 
2: 00— 2:30 P.m. ............ 17.9 64.5 3.5 6.9 
5: 00—- 5:30 P.m. .......... 27.3 70.1 17.8 16.9 
7: 30— 8:00 P.m. ............ 63.2 85.0 24.2 21.1 





* 100% = Total U. 8. urban radio families. 

18 1988 CBS-NBC Urban Radio Study on Sets in Use and Family 
Availability. Unpublished findings based on personal interviews con- 
ducted for the National Broadcasting Company, Inc., and the Columbia 
Broadcasting System, Inc., by Crossley, Inc., in communities over 2,500 


population. 

19 Columbia Broadcasting System, Inc., and the National Broadcasting 
Company, Inc., The Joint Committee Study of Rural Badio Ownership 
and Use in The United States. New York: Columbia Broadcasting Sys- 
tem, Inc., and the National Broadcasting Company, Inc., December, 1938. 
Four sections. 
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there are wide fluctuations in the availability of the audience, 
especially certain age and sex groups. 

The third consideration regarding the hour of broadcasting 
involves a refinement of the availability data by superimposing 
on them the pattern of ‘‘sets in use’’ by half-hour periods. De- 
spite a desirable period in terms of audience availability, the 
number of families with radio sets regularly in use at that 
period must be considered. In Table V are the percentages of 
all urban radio families with sets in use by hour periods for the 
average weekday, Saturdays and Sundays. These data are 
based on the four quarterly CBS studies of 1937 and reflect the 
simultaneous coast-to-coast audiences at the times shown.”° 
Similar data are available for rural radio families.** 

Selecting the best hour for a program involves still more sta- 
tistical consideration. People might be ‘‘at home and awake’’ 
and listening to the radio, but listening to a competing program. 
It is important, therefore, for the advertiser to consider his po- 
tential ‘‘neighbors,’’ not only those who will live across from 
him on competing stations, but those on either side of him on the 
same stations. 

The audience ratings published by the program measurement 
services, when examined in the light of the total ‘‘sets in use’’ 
shown in Table V, will help to answer the competition question. 
The problem of program competition is open to various inter- 
pretations. Advertisers are divided in their opinion regarding 
the importance of competition in the selection of a particular 
time period. It is interesting to note, for example, that four 
out of the ten leading programs listed in Table II are competing 
with each other, indicating that more than one program can 
achieve ‘‘top’’ audiences during the same time period. On the 
other hand, programs aimed at ‘‘popular’’ audiences but with- 

20 These data are from the unpublished records obtained quarterly for 
CBS by Dr. Daniel Starch and Staff, beginning in 1933. They are based 
on 32,000 personal interviews during 1937, in 109 cities and towns over 
2,500 population. These data were summarized and published in Radio 


im 1987, by the Columbia Broadcasting System, Inc. 
21 Op. cit. 
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TABLE V 
Percentage of Urban Radio Sets in Use 
By Hour Periods—1937 
Coast-to-coast averages 
4 
‘old Monday 
i Eastern Standard Time to Friday Saturday Sunday 
6: 00— 7: 00 a.m. ............. 2.2% 14%* 0.9%* 
7:00-8:00 6 wow 10.3 8.0 5.4 
8:00-9:00 “© wou. 17.1 14.5 10.6 
9:00-10:00 * ow. 19.3 17.4 16.8 
10: 00-11:00 §€ ow. 21.3 18.3 20.4 
11: 00-12:00 ** W.. 19.1 16.9 20.0 
12: 00- 1:00 P.M. ........ 18.8 16.7 17.5 
1:00-2:00 “© uu. 18.7 17.4 19.8 
2:00-3:00 ** 19.2 21.3 24.1 
8:00-4:00 “© 20.0 24.8 26.5 
4:00-5:00 ** 19.0 25.5 26.0 
5:00-6:00 ‘¢.............. 19.0 21.5 24.7 
) 6:00-7:00 “6 uu. 26.0 21.7 28.4 
7:00-8:00 * Wu... 39.6 29.1 43.4 
8:00-9:00 © ous. 47.4 37.2 48.5 
9:00-10:00 ** WW. 46.4 38.4 45.4 
| 10: 00-11:00 “* ........ 34.0 30.8 33.9 
; 11:00-12:00 ‘* ...... a 16.9 17.4 15.8 





2 100% = Total U. 8S. urban radio families. 
| out strong, popular talent find it difficult to build or hold an 


audience against well-established programs. 


The effect upon the average and less-than-average popular 
programs in competition with a very successful evening dra- 


. | matic program is shown in Table VI. This tabulation shows, 
Peat eae by three-month intervals, audience indices on a number of 
eG programs, (A, B, C, D, E, and F) which appeared opposite the 
a outstanding broadcast. The figures indicate the number of 
i people listening to the other programs for every 100 persons 


ti listening to the program under discussion (X). 
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TABLE VI 
Quarterly Analysis of Program Competition Showing Relative Audience 
of Competing Programs Over Two-year Period 





Summer Fall Winter Spring Summer Fall Winter Spring 
Program "1935 1935 1936 "Teed 1936 1936 1937 1937 





| . 100 100 100 100 100 100 100 
ae 46 42 36 28 18 OFF OFF 
DP “vnepiicny 57 54 46 44 19 OFF OFF OFF 
Doig wp 48 26 21 20 OFF OFF OFF OFF 
a adihiee “Cepies 89 72 OFF OFF OFF OFF OFF 
ae - juin coins “ie 30 25 13 OFF 
i coebeked-- ieee ane oniné a mein 32 22 OFF 





Over the two-year period, no single program was able to hold 
its own against this particular show. Unless the prospective 
program has a reasonable chance to succeed, either by its overall 
appeal or because it is aimed at a different segment of the audi- 
ence, it is better to consider an hour providing greater chances 
of success. It should be noted that the case shown in Table VI 
is an extreme. With intelligent programming, it is possible to 
‘‘earn’’ a fair share of the total potential audience at any given 
time period. 

It has already been mentioned that contiguous programs are 
important considerations. To “‘locate’’ next to a widely estab- 
lished program means the new program will inherit an audience 
if there is a high-ranking program ahead of it, or have listeners 
tuning in at the end in anticipation of a big show to follow. In 
either case, the presence of the established program helps build 
the new audience if the new program has reasonably good sub- 
stance. Other things being equal, the advertiser who selects 
good ‘‘neighbors’’ gets off to a better start. 

The effect of audience anticipation can be seen in Table VIII. 
This is a composite picture of what happened to the audience of 
three programs when each was followed by an outstanding 
sporting event. The audience ratings are based on a normal 
period of 100 for 12 weeks prior to the special event. On the 
day of the special broadcast the average program immediately 
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preceding the event increased 86 per cent. Similar effects 
result from certain programs preceding others. 


TABLE VIII 
Effect of Special Program on Audience Size of Preceding Program 
Based on a special analysis of CAB ratings 


Number of weeks before special 
6-12 weeks 0-6 weeks ipochdl qouapate 


Audience index. ................. 104s 97 186 











* 12-week average audience rating prior to special program event taken 
as 100. 


All these statistical consideration—station coverage, pro- 
gram selection, and timing—are involved in ‘‘ going on the air.’’ 
The data amassed in connection with their solution should pro- 
vide many fruitful leads for the social scientist. 

The mail received by stations, for example, can be used for 
exploratory studies of regional, occupational or other differ- 
ences between divisions of the population. The results become 
especially significant if they are related to characteristic kinds 
of programs.” Likewise, information on station preferences 
can be interpreted in psychological terms once the appeals of the 
different stations are determined.** 

Program preferences and actual listening can be analyzed 
according to primary characteristics of the listeners such as 
sex, age, education, income and occupation, thus contributing 

22 The April, 1939 issue of The Public Opinion Quarterly will carry an 
article by Jeanette Sayre in which this treatment of data will be discussed. 

28 An example is the relative preferences of low-income groups for local 
stations as discussed by Alvin Meyerowitz and Marjorie Fiske, ‘‘The 
Preference of Low Income Groups for Small Stations,’’ Journal of Applied 
Psychology, XXIII, 1 (February, 1939), pp. 158-162. Similarly, in the 
case of educational stations where the appeal is fairly well established, 
Dr. H. B. Summers, by reanalyzing his rural radio study in the state of 
Iowa for the Princeton Radio Research Project, has found that listeners 


to this type of station are somewhat older and of somewhat higher educa- 
tional and economic status than the general audience. 


mses EE 
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to our knowledge of the audience’s psychological composition.”* 
The use of factor analysis on these data would provide further 
interesting results. Correlations could be computed between 
preferences for different kinds of programs and a number of 
basic factors derived by Thurstone’s techniques; the resulting 
combination of these factors might help to account for what 
listeners get out of different types of radio programs. 

Finally, the data on availability of people could be used for 
purposes quite removed from those for which they were origin- 
ally collected : how frequently are husband and wife, or parents 
and children at home simultaneously in different groups of the 
population? Many students of the family could use this type of 
materially profitably. 

When one realizes that all these data are being compiled not 
once but periodically, he will agree that social scientists should 
keep in touch with the agencies in charge of their collection. 


PROGRAM PREFERENCES OF 
DIFFERENT GROUPS 


Two types of data are available for the study of program preferences: 
data from telephone interviews regarding programs listened to at the 
time of the interview or during a specified preceding interval; and state- 
ments by listeners regarding programs they prefer or programs they 
listen to regularly or frequently. The first type of data, as collected in a 
number of audience surveys, is more objective, but rarely can be analyzed 
in terms of group differences because so little information is available 
concerning the respondent. Hence our information on program prefer- 
ences in different groups must be derived from the second type of data. 

Even such information, however, is subject to a number of distortions. 
The preferences indicated by people may be influenced by the formula- 
tion of the question asked; by the nature of the checklist, if one is in- 
eluded; by the context in which the question is asked, or by what the 
person has just been listening to over the radio; and by the number and 
kind of programs available to the listener from day to day. 


25 Some indications are given in the article by Isabelle F. Wagner, 
**Program Preferences of Different Groups,’’ Journal of Applied Pay- 
chology, XXIII, 1 (February, 1939), pp. 187-192. 
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Yet in spite of the fact that the available studies have been conducted 
under varying circumstances, certain similarities in preference trends can 
be traced. It therefore seemed worthwhile to assemble all the preference 
studies which have appeared from 1934 to the present date.1 The best 
use of this kind of data will be made in the study of very specific problems. 
For instance, we might take a preference for news programs and trace 
it for different groups through all available studies, with the purpose of 
analyzing what accounts for variations.2 In the course of this analysis 
we may bring to light still other important issues, such as the question 
of what a person specifically likes or dislikes about a given program. 

Of course, this type of analysis should consider the special conditions 
under which the different surveys have been made. In one study con- 
ducted in 1937 (10), for example, Major Bowes’ Amateur Hour was 
given a high preference rank by a well-to-do group, whereas in a 1938 
study (13), the highest preference was expressed by the lowest economic 
strata. That might be an indication that program fashions behave like 
fashions in dress: Perhaps they start in the upper economic strata and 
then filter down to lower strata at a time when the former have already 
turned to new preferences. Once such an hypothesis is developed, it can 
be checked by scrutinizing the existing studies just from this point of 
view. 

Another example is furnished by the fact that the few available tables 
on amount of listening and age seem to show that amount of listening 
decreases as the age of a group increases. A closer examination of the 
available samples shows, however, that they are taken largely for espe- 
cially interested groups, for instance, members of a book club (5), or 
visitors to a fair (18). This might mean that we eliminated those more 
passive aging people who, for this very season, might listen to radio more. 
As a consequence, the student will want to request special tabulations 
from those agencies who have made house-to-house canvasses and have 
information on age of the respondents without having tabulated it against 
amount of listening. 

Finally, preference figures can be utilized to greater advantage if 
certain theories are developed regarding the psychological significance 
of various programs. For example, one might work from the assumption 
that there are two different types of listeners: those for whom radio is 
especially important because it conveys music, and those who prefer the 
spoken word over the radio. This assumption can be tested by seeing 
whether we find a special clustering of musical programs and of verbal 

1 An acceptable summary of studies up to this date is given in F. H. 
Lumley, Measurement in Radio, 1934. 

2 Such an analysis is being made by Professor 8S. Stouffer, University 
of Chicago, for the Princeton Radio Research Project. 
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programs in the preference lists of the respondents. Another more obvious 
distinction is that between serious or cultural programs, and programs 
more specifically designed for entertainment. Among the entertainment 
programs a number of finer distinctions will be advisable, such as the 
level of sophistication implicit in the entertainment offered. 

In brief, the study of program differences will prove most significant 
if we use classifications based on a preceding psychological analysis— 
classifications which go far beyond the categories now used by the 
broadcasting industry. The value of the studies collected in the follow- 
ing bibliography rests partly on the possibility of trying out many classi- 
fications of this kind, and of checking whether they bring group differences 
of any kind to the foreground. 

An initial analysis of the material listed in the bibliography shows a 
number of rather definite trends. For instance, interest in serious 
programs (classical music, news, and educational programs) increases 
with age and socio-economic status, irrespective of whether the latter is 
measured by income, occupation, or education; at the same time, interest 
in variety and comedy programs and in serial drama decreases. The 
more remote an area is from large cities, the greater on the whole is the 
preference for news programs and for the more ‘‘folksy’’ type of enter- 
tainment. The upper seaboard states in the East have the most sophisti- 
cated, and the southern states the least sophisticated, program preferences. 
Differences between the sexes are not easy to appraise because men listen 
for the most part in the evening, whereas most women listen also during 
the day; for this reason the great differences in program design between 
daytime and evening broadcasts must be considered. Nevertheless, men 
tend to favor news and variety programs slightly more than do women, 
and show less interest in musical programs and either complete or serial 
drama. 

The following bibliography is designed to show size and origin of sam- 
ple as well as the agency responsible for the collection of the data. The 
student who wishes to follow up a special problem can get in touch with 
the sponsors. Meanwhile an analysis is in progress for a forthcoming 
publication by the Princeton Office of Radio Research. 


BIBLIOGRAPHY 
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452. 
Place: West coast. Subjects: 955 KECA listeners who subscribed for 
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Thesis on file at Princeton University Library. 

Place: Two counties in Utah; three New Jersey towns. Subjects: 
About 1,680 people. Method: Personal interview. 
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. Fortune, 1938. Original work-sheets on file with Time Publishing 
Co.; analysis made by Princeton Radio Research Project. 

Place: United States. Subjects: Over 5,000 people. Method: Per- 
sonal interview. 

G. FraunHar, Annoyances in radio programs. Public Opinion Quar- 
terly, 2, 1938, 627-635. 

Place: Cambridge, Mass. Subjects: 398 men and women; from Har- 
vard, Y.M.C.A., Y.W.C.A., a department store, a night school, 
ete. Method: Questionnaire distributed at meetings. 

. K. M. Goopz, What about Radio?, 1937, 122. (Report of WOKO 
survey.) 

Place: Albany; N. Y. State College for Teachers. Subjects: 517 
teachers. Method: Mailed questionnaire. 

. F. EB. Huu, Listen and Learn, 1937, 104. (Report of survey by Allen 
Miller). 

Place: Chicago, 1934, Subjects: 1,500 homes. Method: Mailed 
questionnaire. 

. L. L. Lanesporr, Is anyone listening in? Eztension Service Review, 
7, 1936, 174-175. 

Place: Kansas. Subjects: 800 farmers. Method: Personal interview. 

. Market Analysts, Inc. Study made at New Jersey State Fair, 
Trenton, in 1938. Report on file at New York office. 

Place: Trenton, New Jersey. Subjects: 675 people. Method: Per- 
sonal interview. 

. T. RIEDELBAUCH, Radio as an Advertising Medium, 1936. M.A. Thesis 
on file at University of Wisconsin Library. 

Place: Madison, Wisconsin. Subjects: 200 housewives. Method: 
Personal interview. 

. F. Stanton, Program Preferences, 1935. Also author’s original 
work-sheets. 

Place: Dayton, Ohio. Subjects: 1,000 people. Method: Mailed 
questionnaire. 

. H. B. Summers, Iowa Rural Radio Listener Survey, 1938, 12-15. 

Place: Iowa; farms and small towns. Subjects: 5,771 families, of 
which 5,149 owned radios. Method: Personal interview. 

. H. B. Summers, 1938 Kansas Radio Listener Survey, 1938, 12-13. 

Place: Kansas; farms, small towns, large towns. Subjects: 5,864 
radio families. Method: Personal interview. 

. U.8. Department of Interior, Office of Education, The World is Yours, 
1937. 

Place: United States. Subjects: 35,892 people on ‘‘ World is Yours’’ 
mailing list. Method: Mailed questionnaire. 

. WCAU, A Radio Survey of Philadelphia, 1936. 
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Place: Philadelphia. Subjects: 35,623 people. Method: Question- 
naires distributed by Boy Scouts to door. 

25. WFBL, Survey of WFBL News Programs, 1938. 

Place: Area covered by WFBL. Subjects: 718 people who had re- 
quested news booklets. Method: Postcard with questions. 

26. Woman’s Home Companion, 1937. Original work-sheets on file with 
Crowell Publishing Company; analysis made by Princeton Radio 
Research Project. 

Place: United States. Subjects: 588 women subscribers. Method: 
Mailed questionnaire. 

27. WQXR, Data on Program Preferences, 1937. Unpublished data, on 
file at WQXR. 

Place: New York City and vicinity. Subjects: 665 WQXR listeners 
who bought program booklets. Method: Mailed questionnaire. 

28. WTMJ, The Listening Habits in Greater Milwaukee, 1934, 50-51. 

Place: Milwaukee. Subjects: 50,000 radio families. Method: Per- 
sonal interview, postcard, telephone. 
IsABELLE F. WAGNER, Princeton Radio Research Project, 
assisted by 
Maroaret Exs, Psychological Corporation. 


CURRENT RADIO RESEARCH IN 
UNIVERSITIES. 


T the request of the guest editor, reports were sent in 
from a number of institutions. These reports were 
condensed for publication by Dr. Isabelle Wagner. 


KANSAS STATE COLLEGE 


Kansas State College was one of the pioneers in the field of giving 
classroom instruction in radio broadcasting ; courses dealing with the pro- 
gram side of radio have been available to students since February, 1932. 
At the present time, the departments of Journalism, Music, and Public 
Speaking offer a total of nine courses in various phases of broadcasting 
technique, in addition to work given in radio communication in the school 
of Engineering. 

From the beginning, emphasis has been placed on training students for 
educational rather than for commercial broadcasting, although many 
graduates have gone into commercial work. A good deal of stress has 
been placed upon the importance of the listener, and for several years 
students have been encouraged to carry on informal research work in 
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fields relating to listener habits and preferences. A number of them 
have worked as interviewers in commercial surveys of the Kansas radio 
audience. 

Since last winter, research in various phases of broadcasting has been 
further stimulated by offering college credit to seniors and graduate stu- 
dents who carry on approved research projects in radio. One student has 
completed a Master’s thesis in radio;1 another Master’s thesis is under 
way, and several less extensive projects have been completed or are being 
earried on at the present time. 

One student last spring used the mail-questionnaire method to secure 
data concerning the attitude of Kansas educators toward educational 
broadcasts intended for grade-school and high-school students. He found 
that 80 per cent of the schools represented in the replies are already 
equipped with receivers; that nearly all of the remaining schools would 
install equipment if suitable programs were made available. Most super- 
intendents who replied prefer that broadcasts be made during school 
hours, in units of 30 minutes; three-fourths of them asked for programs 
suitable for use in junior high schools, two-thirds would use programs in 
senior high schools, and half desired programs adapted for students be- 
low the junior high-school level. The great majority suggested that 
broadcasts be supervised by the office of the state superintendent of pub- 
lic instruction, but nearly all asked that the actual broadcasting be in 
charge of a professional radio man to insure a degree of interest greater 
than that usually found in broadcasts from strictly educational stations, 
and the majority favored the use of commercial stations to handle the 
educational programs, rather than one of the two state-owned stations 
now operating in Kansas. 

Another undergraduate study dealt with the type and length of com- 
mercial announcements on 101 network commercial programs. The stu- 
dent in charge listened to a minimum of five broadcasts of each of the 
programs selected, stop-watch in hand, and averaged the length of time 
devoted to commercials on the five broadcasts. The resulting figures give 
a fairly clear picture of one of the reasons why many listeners complain 
of advertising on daytime programs, but register little or no objection to 
the advertising on evening shows. On evening programs, less than 9 per 
cent of the total sponsored time is devoted to commercials, as compared 
with a daytime figure of 17 per cent. In addition, nearly half of the 
full-hour or half-hour evening shows use novelty methods of presenting 
the commercial—working it into the script of the show, or having it pre- 
sented by one of the featured entertainers on the program, or giving it in 
dialogue or in dramatized form. During the daytime, only one program 

1R. D. Michael, College and University Radio Broadcasting in 1927. 
In manuscript form, at the Kansas State College library. 
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in 17 uses any method other than straight commercial talks by an 
announcer. 

Fora third study dealing with listener reaction to commercial an- 
nouncements, a student interviewed 125 adult listeners. Of these, 61 per 
cent preferred sponsored programs, and 21 per cent, sustaining programs. 
Furthermore, 45 per cent objected to radio advertising; commercials were 
too long, made absurd and extravagant claims, were insincere, or inter- 
rupted the continuity of the program. Nearly all agreed that the com- 
mercials on daytime serial dramas were especially offensive. Although 
89 per cent had at some time tuned out programs because of irritation at 
their commercials, only 2 per cent had done so ‘‘frequently,’’ and only 
34 per cent would be willing to pay a small radio tax which would elimi- 
nate advertising. At the same time many expressed approval of specific 
programs on which the commercials were handled in such a way as to 
create a favorable response. 

At the present time, three other studies are being made whose results 
should be of interest. One is an attempt to determine the reaction of 
children to certain voice qualities. The student making this study has 
recorded the voices of five women speakers, all of medium pitch but rep- 
resenting various quality levels between softness and harshness, and is 
playing these records before a number of groups of children in the first, 
second, and third grades, asking the children to check individually their 
replies to the question, ‘‘Which of the people who talked do you think 
you would like best?’’ A similar test is being made, using voices of 
**medium’’ quality, but representing five different levels of pitch. A 
later study will use the came procedure in testing men’s voices, and will 
attempt also to discover any variation in the response of children to the 
voices of women and of men. 

A second undergraduate study now in progress attempts to discover 
whether children in the lower grades show any marked preferences for 
one type of presentation of narrative materials over other types, and 
whether preferences are related to age, sex, or grade level. The student 
handling this study has selected three subjects for treatment, all from the 
field of early American history, and all of approximately equal interest 
to children. Each of the three subjects has been developed in three 
distinct ways—straight narrative given by a single speaker; single- 
speaker narration supplemented by sound effects and short dramatized 
sections; and out-and-out dramatization. Records have been made of 
the different treatments, which are played back in various combinations 
before from forty to fifty different grade-school classes. 

A more ambitious study has recently been started by a graduate stu- 
dent who plans to carry on his investigation over a period of two years. 
In general, his technique is an expansion of that of the project just 
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described. Three subjects have been selected for presentation; since 
this study is an investigation of the reactions of adults, each subject 
relates to some little-known but interesting historical character; the in- 
terest levels of the different subjects are approximately equal. Five or 
six significant facts have been selected for presentation concerning each 
of the subjects chosen; and information concerning those facts for each 
subject is given by five methods—straight talk, two-speaker dialogue, 
interview, dramatization, and talk illustrated by use of sound effects or 
dramatization. Every effort has been made to secure presentations of 
the fact materials, using different methods, o° approximately equal 
quality. As suitably balanced scripts are prepared, presenting each 
subject by each of the five methods of development chosen, the materials 
are produced with the aid of playing casts of college students with 
broadcasting experience, and the presentations are recorded. The stu- 
dent will use different combinations of records played before high-school 
students, college students, civic clubs, labor organizations, women’s clubs, 
and farm organizations until perhaps three or four hundred different 
groups have been reached, and tests given to five or six thousand dif- 
ferent persons. In this way he hopes to discover the relative effective- 
ness of the different methods of presentation used in presenting factual 
information to listeners, and to see whether or not the usefulness of the 
different methods is affected by age, sex, or extent of education. 

No other studies are in progress at Kansas State at the present time. 
Within the next few weeks, however, one student plans to begin a survey 
of the effect of news broadcasts on newspaper reading, and of listener 
preferences for certain types of radio news ‘presentation. Another is 
undertaking a study of the popularity of various children’s programs 
among city and country children in different age groups. A third ex- 
pects to investigate the buying habits of some 50 or 60 rural housewives, 
and the extent to which brand preferences are influenced by radio; while 
a fourth is planning a similar study among housewives living in a large 
city. Two or three others have not finally selected fields for study. 

The problems chosen for study by undergraduates are not particularly 
ambitious and the methods used are often crude. But the work done is 
of value not so much for securing important data as for making students 
conscious of the possible values of research in radio broadcasting. 

H. B, SUMMERS 


OHIO STATE UNIVERSITY 


The Evaluation of School Broadcasts is a study sponsored by the 
Federal Radio Education Committee and involving the active cooperation 
of educators and of network and independent broadcasters. The major 
purpose of the undertaking is to gather evidence regarding the effective- 
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ness of radio broadcasts, planned for use in school, in achieving a variety 
of educational objectives which broadcasters and teachers alike feel are 
important. The study is carried on through groups of interested 
teachers in several geographical centers in which broadcasts are origi- 
nated in order that the broadcasters may meet with each of the teacher 
groups. The project is supported by a grant from the General Educa- 
tion Board. 

byrne, ebay harap oman -caetenbyan ok 

- To what kinds of educational objectives may broadcasts be expected 
to contribute? 

2. What kinds of programs may be expected to contribute to each of 
these important objectives? 

3. What types of utilization of the broadcasts by teachers are most 
fruitful in achieving these objectives? 

4. What kinds of behavior on the part of pupils will indicate achieve- 
ment of each of these objectives? 

5. What kinds of evaluation instruments (tests, observations, reading 
records, and the like) will be most effective in gauging the 
achievement of these objectives? 

6. What contributions can be expected from each of these types of 
broadeasts—nation-wide, regional, and local? 

While the staff is centered at Ohio State University, the actual work 
of the project is carried on in the cooperating centers in which groups 
of teachers are meeting with broadcasters. Beginning with a considera- 
tion of the important objectives, the groups then plan the details of the 
project as it is being carried on. Another function of these meetings 
is the definition of problems and their clarification through group 
thinking. 

The four subject fields in which work is carried on are fields in which 
there are the greatest number of broadcasts. These are music, social 
studies, English, and science. The staff members working with the 
project include research associates and research assistants in each of 
these subject fields, who were selected because of their ability to give 
leadership in the field and for their acquaintance with the specialized 
techniques of evaluation. The director and associate director coordinate 
and integrate the work carried on in the verious subject fields, and give 
special counsel in relation to radio education and evaluation. 

The study is confined to programs used in the classroom, and actually 
**on the air’’ during the period of the study. Limitation of the staff 
personnel makes it necessary also to confine the study to programs in 
only three or four major fields. 

Certain guiding principles are accepted by the staff as indicating the 
nature of the work to be done. These are as follows: 
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Attack is cooperative among teachers, broadcasters and staff. 

Evaluation is to be undertaken of results achieved by superior 
teachers; it is not a ‘‘status’’ study but a ‘‘potentiality’’ study. 

Evaluation is to be based on evidence regarding achievement of 
important objectives, not necessarily easy-to-test objectives. 

Selection of objectives and determination of their relative impor- 
tance is task of teachers and broadcasters, not staff. Staff will, 
of course, give guidance. 

Study involves careful gathering of evidence over several years 
with regard to various objectives. It does not necessarily involve 
simultaneous gathering of data on the same objectives in all 
centers. 


The general techniques employed in the study may be listed as follows: 


1. 


3. 


Gathering and clarifying the educational objectives in each subject- 
matter area. 

Selecting tentatively the particular objectives to which educational 
broadcasts appear most likely to make a significant contribution. 

Defining these objectives in terms of pupil behavior. 

Collecting, organizing, and interpreting numerous examples of pupil 
behavior which can be taken as indicative of achievement in the 
direction of the selected objectives. 

Gathering descriptions of methods for utilizing broadcasts. 

Devising techniques and constructing instruments for collecting 
evidence of pupil achievement in each of these objectives. 

Refining such instruments and eine aad and improving their gen- 
eral practicability. 

Using these instruments and techniques in collecting evidence (1) 
concerning the effectiveness of school broadcasts in achieving the 
educational objectives for which they have been utilized in this 
study, and (2) with regard to various described methods of 
utilizing the broadcasts. 


. Treating evidence, thus collected, in a variety of ways in order 


to obtain certain inferences and to formulate criteria and gen- 
eralizations regarding the effectiveness of educational broadcast- 
ing, methods of utilization, place of local, regional, and national 
broadcasts, and the like. 


The work already accomplished and now under way is of four types. 
These are: 


A. Clarification of Objectives 


As a result of the meetings with teachers and broadcasters, the objectives 
which the teachers felt were important were classified into seven categories. 
These are not mutually exclusive but they represent in a general way the 
types of educational purposes which teachers feel are important. The 
classification is as follows: 
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Attitudes and Appreciations. 

Interests and Self-Motivation. 

Critical Thinking and Discrimination. 

Creative Expression. 

Social Behavior and Personal-Social Integration. 
. Skills and Techniques. 

- Informatioval Background. 


In each of the broad subject fields, music, English, science, and the 
social studies, objectives were stated under each of the seven categories. 
Such statements might still be vague and carry different meanings for dif- 
ferent persons, so that it was necessary to define each objective in terms 
of the behavior characteristics of pupils who have achieved the objective. 
These ‘‘ behavior instances’’ were collected from the teachers and repre- 
sented their observation of what pupils did who had achieved each of the 
objectives. The list of behaviors for each objective then becomes a 
‘*definition’’ of the objective. These objectives and the defining behavior 
have been collected and issued in tentative form as a bulletin with the 
title, Dictionary of Objectives. 

This work with objectives was extremely important in the radio study. 
Most of the previous studies of the effectiveness of radio programs have 
been based upon information alone; but it is probable that the distinct 
contribution of radio programs is to fields other than information. 


a g po 


Io 


B. Development of Tentative Test Instruments 


A second type of work which has been undertaken has resulted from the 
work with objectives. This is the development of some instruments of 
evaluation in tentative form. A few of these were developed in the spring 
of 1938 and were tried out by some of the cooperating teachers. A much 
larger number were developed during the summer through the cooperation 
of the Summer Workshops of the Progressive Education Association. 

In cooperation with the General Education Board and the Progressive 
Education Association, the staff members of the project became staff mem- 
bers at three of the summer workshops which were conducted at Bronxville, 
New York; Denver, Colorado; and Oakland, California. A special grant 
from the General Education Board enabled the project to give fellowships 
to thirty-seven persons, of whom most were cooperating teachers. These 
persons came to the workshops and worked intensively with the staff. 
Most of the instruments of evaluation which were used in the fall of 1938 
were developed in these workshops. In addition, special committees at 
the workshops prepared other materials, such as a manual on the utiliza- 
tion of broadcasts, scripts for severa] series of school broadeasts, and out- 
lines for work in radio program discrimination. 
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C. Improvement of Test Instruments 


Two procedures are being utilized in the second year of the study for 
the improvement of instruments of evaluation which have already been 
developed. The first, consisting in the enlargement, critical editing, and 
improvement of testing techniques, was carried out by the staff mem- 
bers after the return from the workshops. The second method for im- 
proving the instruments is to utilize them in exploratory studies and then 
to make a careful study of their validity and reliability. 


D. Ezploratory Studies 


There are now twenty-one exploratory studies under way. One purpose 
of these studies was to gather data for the improvement of the instruments, 
but there are other important purposes. They will provide, for example, 
valuable evidence as to techniques which can be utilized in making studies 
of the effectiveness of school broadcasis. What type of anecdotal record, 
for example, can teachers be expected to keep? Can instruments be de- 
veloped sufficiently sensitive to record changes in behavior occurring from 
a single broadcast or two or three broadcasts, or must the study involve an 
entire series of programs in order to give reliable results? What types 
of cooperation can be expected from teachers in evaluation studies? 

Another purpose served by these exploratory studies is to give evidence 
which will serve as the basis for more careful studies later. Various 
**hunches’’ regarding results of broadcasts are being studied. Some of 
them may prove fruitful and others may have to be discarded. The com- 
plete results from this group of studies will give abundant guidance for 
the planning of a series of more comprehunsive studies later in the project. 

I, Kerra TYLer 


UNIVERSITY OF WISCONSIN 


‘*To determine through demonstration and evaluation the place of radio 
in the classroom and to devise methods for its most effective use. .. .’’ 
This was the official statement of purpose of the Research Project in School 
Broadcasting, now being carried on by the University of Wisconsin. Its 
two-fold purpose, demonstration and evaluation, has been made possible 
through cooperation with Wisconsin’s state-owned stations, WHA and 
WLBL, and the Wisconsin School of the Air. 

During its seven years of experimentation with school broadcasting, the 
Wisconsin School of the Air has had a steadily increasing audience of 
Wisconsin schools. The State Department of Public Instruction has en- 
couraged the use of broadcasts in the schools, teachers and school adminis- 
trators have helped to plan programs, and even the University has given 
assistance. Under the direction of Professor H. L. Ewbank of the Depart- 
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ment of Speech, several graduate studies have been made testing the 
effectiveness of radio techniques arid types of presentation. These factors, 
together with the splendid facilities and cooperative staff of WHA, pro- 
vided for the project an ideal foundation in local experience and resources. 

In arranging experimental programs, the project has been guided by 
two fundamental principles. First, broadcasts should meet school needs 
and contribute to the attainment of educational objectives. Second, 
teachers should be fully informed as to the purpose and nature of the 
broadcasts, and given suggestions as to their most effective use. To carry 
out these principles, a careful analysis is made of the school curriculum and 
of objectives in line with the most progressive practice. 

An advance announcement of the schedule of broadcasts for the follow- 
ing year appears in the May issue of the Wisconsin Journal of Education, 
which goes to all teachers of the state. This is followed in the September 
issue by more detailed information in regard to the series to be offered. 
Teachers are asked to register listening classes for each series, and as soon 
as these registrations are received, a complete outline of the broadcasts is 
sent out in the form of a ‘‘teacher manual.’’ These manuals include also 
a statement of the educational objectives of the series and suggestions as 
to curriculum correlation, preparation for the broadcasts, follow-up 
activities, and proper listening conditions. 

The steadily increasing use of the broadcasts in Wisconsin’s elementary 
schools has led to registrations like the following: 








Community Li . 775 classrooms 11,500 pupils 

Neighbors Round the World 1030 classrooms 16,000 pupils 
with Mac ....... 1150 schools 25,000 p 

Prof. Gordon’s Class 1282 schools 31,000 

Let’s Draw 926 schools 21,000 pupils 


Audiences for experimental broadcasts for high schools are compara- 
tively small, partly because broadcasts specificially planned for high 
schools are a new feature of the Wisconsin School of the Air, and still 
more because of the scheduling difficulties common to all secondary schools. 
An experimental series called ‘‘Good Books,’’ planned to stimulate interest 
in leisure reading, now has an audience of about 2500 listeners in 80 
schools. This ie to be followed Guring the cocend half of the asheol year 
by a ‘‘Good Speech ’’ series. 

The second phase of the Wisconsin study—evaluation of educational 
results—involves the use of control schools, not equipped for radio listen- 
ing, in which teachers undertake to accomplish not only the objectives of 
their regular instruction, but also those additional aims set up for the 
experimental broadcasts. Since the purpose of school broadcasts is, in 
general, to supplement and enrich rather than to give curricular instruc- 
tion, evaluation is less in terms of information than in terms of interests 
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and activities stimulated, attitudes changed, and appreciations encouraged. 
An attempt is being made to measure these results so far as possible in 
terms of pupil behavior. The complete control of the broadcasts through 
all the stages of planning, preparation, production, school use, and evalua- 
tion is a unique feature of the Wisconsin Project. 

While the evaluation of the current series of experimental broadcasts 
will not be completed until the end of this school year, it is not too much 
to hope that the Wisconsin Project, by demonstration as well as by evalua- 
tion, may make a significant contribution to the development of school 
broadcasting. 

Lester W. PARKER 


PRINCETON UNIVERSITY 


The School of Public and International Affairs at Princeton Univer- 
sity established an Office of Radio Research, which has functioned since 
September, 1937. At this time a Rockefeller grant was secured to 
finance a radio research project to be carried out by this office. From 
the annual report of the project the following data have been selected. 

A series of publications has been planned: 

1. Measurement Techniques. This book will be a critical analysis of 
the methods used to measure listening habits. 

2. The Art of Asking Why. This publication will contain an analysis 
of the more outstanding theories of motivation found in modern psy- 
chology, together with « critical discussion of their usefulness for an 
understanding of social action. New developments in the field of inter- 
viewing and testing will be considered. The) volume will contain the 
results of studies on why people like certain programs and what deter- 
mines their radio habits in general. 

3. Radio Commentators. This book will describe the rise of the com- 
mentator and news broadcast in this country, and their status and func- 
tion at the present time. A dozen interlocking studies will be included 
in the volume to indicate ways in which the influence of the commentator 
and news broadcasts can be studied. 

4. Music on the Air. This volume will contain a discussion of the 
changes radio brings about in the music world of our times. Separate 
studies will be concerned with the kind of musical programs broadcast, 
factors which account for the success of song hits, ete. The book will 
be the first comprehensive treatment of radio music. 

5. Radio and Reading. Separate studies are in progress concerning 
the relationship between listening and reading habits in different groups. 
A general survey of the book programs on the air during recent years 
has been conducted. Special studies are being made in connection with 
three different kinds of book programs currently broadcast over Station 
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WOI, Ames, Iowa. In cooperation with the Book-of-the-Month Club, in- 
formation has been collected on three thousand people which permits com- 
parisons of reading and listening. 

6. Studies in Educational Broadcasting. This volume will contain 
separate studies of educational programs. The results of these studies 
will be combined into a general survey of the effectiveness of non-com- 
mercial broadcasting, including suggestions for its future study and 
improvement. The volume will include a ‘‘potential interest’’ test 
devised by members of the project to measure the accessibility of indi- 
viduals to education over the air. As a further contribution we hope 
to have a study on the use of network programs in schools over the 
country. 

7. Radio in Different Walks of Life. We have, so far, conducted a 
study on radio listening in a rural county in the middle West. This 
study, planned and financed by the Columbia Broadcasting System, is 
being finished under our supervision. A study on radio listening among 
industrial workers is planned. 

8. A Study of Mass Hysteria. Immediately after the Orson Welles 
broadcast of ‘‘The War of the Worlds,’’ a special study was set up to 
investigate the extent of the scare spread, the kind of people who were 
affected, and so forth. Statistical data as well as detailed interviews 
are being collected. 

9. The Panel as a Tool in Listener Research. This publication will 
contain the results of two experiments with listener panels. One involves 
a two-months’ study with three hundred Newark high-school students, 
and one is a six-months’ study with four hundred adults over the country. 
In addition, specific experiments on the value of panel techniques will be 
discussed. Our first efforts in program testing will be included, although 
the bulk of such work is reserved for the next phase of the project. It is 
hoped that this text will be of immediate use to anyone connected with 
program improvement. 

10. Statistical Methods as Applied to Radio Research. This volume 
will include a number of new statistical formulations for treatment of 
data obtained in radio research. It will indicate the extent to which 
mathematical formulations can open new areas of listener research and 
lead to practical results. Although this approach will be of interest 
mainly to statisticians, it should be included in the series to show the 
wide range of research problems related to radio, and to promote the 
cause of quantitative methods in the social sciences. 

11. Handbook on Listener Research. This book will summarize the 
methods applied by the Princeton Project. It will have a definite 
text-book character, and will be directed toward students in the social 
sciences. The book should provide a much needed methodological treat- 
ment for field workers, in carrying on radio research. 
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As the work of the project proceeded, a number of basic principles of 
procedure were formulated. 

1. Duplication with commercial research agencies should be avoided 
wherever possible. The results obtained and the techniques developed 
by commercial research agencies should be collected systematically and 
brought to the attention of the educators. An effort should be made to 
develop a special field of ‘‘listener research’’ similar to other fields such 
as ‘‘educational research’’ or ‘‘public health research.’’ 

2. Inasmuch as radio educators today cannot spend large sums of 
money for ‘‘listener research,’’ short-cut methods should be developed. 
They should permit the educator to pre-test programs, gauge their effec- 
tiveness, and appraise the kind of audience they have. Much attention 
should be given to the use of listener panels, which might finally prove 
a valuable contribution to ‘‘listener research’’ in general. 

3. A theoretical framework must be developed to guide us in empirical 
research and in our interpretation of the findings. What we should try 
to do is to derive general ideas as to the possibilities and limitations of 
education over the air by the systematic study of actual efforts made 
currently with educational programs. In analyzing the experiences 
which educational broadcasters have with their audience, we should, so 
to say, weave back and forth between field work and conceptual generali- 
zations. 

4. A number of main fields in which radio obviously has its greatest 
social effects should be surveyed in a general way and plans should be 
outlined for future studies in these fields. These studies should provide 
sound material for a discussion of the role of radio in contemporary life. 
Music, news broadcasting, and politics seem to be natural units for such 
an effort. 

5. Careful attention should be given to social, regional, and other 
differences. For the idea of one ‘‘radio audience’’ we should substitute 
the study of farmers, industrial workers, old people, and the like, as 
radio listeners. Additional studies of this kind are needed and are 
outlined for the second phase of the project. 

6. The interest of universities and other research agencies should be 
stimulated to the extent that they will pay more attention to radio 
research. To this end, a number of problems which could be of special 
interest to psychologists and sociologists have been selected to show the 
wide range of application which modern research techniques may have 
in the field of listener research. 

7. A great number of agencies are currently conducting radio research, 
each concerned with problems of its own. Educational radio research 
handicapped by lack of funds can gain much of its needed information 
by cooperating with other studies. The Princeton Project should set 
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examples for such kinds of joint activity. The American Institute of 
Public Opinion, a number of editors of national magazines, the Book-of- 
the-Month Club, the networks, and a number of independent stations 
have generously cooperated with us. 
Pau F. Lazarsre.D, Director 
Hapiey Cantrin, Associate Director 
Frank STANTON, Associate Director. 


WAYNE UNIVERSITY 


In the Spring of 1937 Wayne University started to experiment with 
developing a radio research technique for measurement of listening 
habits which would be inexpensive and yet fairly reliable, and one which 
might best be carried on through the schools. An examination of the 
radio research surveys revealed these general types: ‘‘telephone’’ survey 
which uses either the coincidental or unaided recall method; ‘‘ personal 
interview’’ with unaided recall or assistance of a roster of programs; 
the ‘‘mail analysis’’ survey which utilizes questionnaires or ordinary 
response analysis; and the youngster, ‘‘automatie recording,’’ with an 
objective check on the time a set is turned on and to which station. 
Since none of these was suitable for our purposes, a ‘‘listening table’’ 
was worked out which borrowed the element of coincidental recall from 
the ‘‘telephone survey’’; the program roster from the ‘‘ personal inter- 
view’’; the questionnaire from the ‘‘mail analysis’’; and objectivity 
from ‘‘automatic recording.’’ Then to this mixture was added the 
elemert of receiving information on the number of listeners in each 
family for each program as well as who those persons were. On the 
listening table, the day from 6 A.M. to midnight was divided into quarter- 
hour periods with space opposite each time unit for the family to mark 
down the station, program, and listeners as each program is heard. This 
table was distributed to families of school children through teachers in 
the schools. The first time this survey technique was tried not only 
were the families requested to fill out the tables for a week if possible, 
but a number of other questions were also asked regarding kind of pro- 
grams liked best by male listeners and by female listeners; awareness 
of meaning of ‘‘electrical transcription’’; reactions to commercial 
announcements on programs; age of radio, family car, and car radio; 
and age levels of family members. 

When a second survey was made from May 20 to 26, 1938, each family 
was asked to fill out the table for a single designated day. No questions 
were asked except those regarding telephone ownership and details of 
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elementary, three intermediate, three high school, and one college— 
distributed the tables. The number of families surveyed in the 1938 
project in each school division was roughly proportionate to the total 
number of students in each. Here are the figures: 10,881 college stu- 
dents—41 families surveyed; 44,000 high school—255 families; 35,000 
intermediate—196 families; and 263,937 elementary—877 families. An 
equivalent survey conducted by telephone, and using the coincidental 
method, would require over 98,000 phone calls to achieve such an analysis 
of 72 quarter hours each for the 1,369 families surveyed. But our 
sample could not have been covered by this technique, since only 36.9 
per cent of the families possessed telephones. 

Tabulations have been made as to average listening time for the 
different days of the week; the actual per cent of radio listening time 
devoted to the various stations by morning, afternoon, and evening, by 
each day of the week, and by the entire week; rank of programs accord- 
ing to percentage of families and by number of persons listening for 
each day; and detailed information on the listening audience of each 
station’s programs by the quarter-hour for each according to number 
of families and persons. These results have been distributed to members 
of the Adcraft Club of Detroit for whom the survey was conducted and 
to other interested groups such as advertising agencies, sponsors, and 
networks. An analysis of the listening habits of the various age groups 
of children 5 to 11, 12 to 14, 15 to 17, and 18 to 21 is being mado at 
the present time. Remaining for study and analysis are such things as 
respective program favorites of men and women; preference for different 
types of programs; average length of listening time for each member 
of the family; shift in listening audience according to program type, 
time of day, day of week; listening habits by income groups and nation- 
ality groups; and listening habits of phone and non-phone families. 

The primary emphasis thus far has been placed on the development of 
a technique. With careful attention to correct sampling, distribution 
of listening tables, and tabulation of the raw data, the technique of 
‘*listening tables’’ should assist materially in obtaining at small cost 
quite detailed information about radio listening. 

Garnet R. GARRISON 


UNIVERSITY OF MISSISSIPPI 


A questionnaire has been formulated for the study of radio listening 
habits, effects of listening, and attitudes toward radio programs and gov- 
ernment control of radio. The following item suggests a new approach 
to the question of the effects of radio programs: 


Indicate degrees of effects of the different types of radio programs by 
writing one of the following words before each of the ten statements 
below: All, Most, Many, Few, No. 
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radio advertisements have made me buy an article. 
—______classical pieces have made me appreciate music more. 

) play productions have made me appreciate drama more. 

) educational programs have broadened my knowledge. 
—___________humorous programs have made me laugh. 

news have had informational value for me. 

popular and jazz pieces have made me like music more. 
—______propaganda speeches have influenced me. | 
—______religious programs have been beneficial to me. 
—______sport broadcasts have been enjoyable to me. 


About three hundred university students have filled out the questionnaire. 
Additional information was secured regarding such factors as sex, class, 
favorite school subjects, size of family, size of home community, and 


father’s occupation. Questionnaire results will be interpreted in terms of . 
these factors. 











mst 





DanizeLt D. Dropa 
8ST. ANDREWS UNIVERSITY, SCOTLAND 


Mr. Pierce, now in New York, has collected questionnaire responses 
for groups of British listeners in Scotland and Lancashire. A pilot 
survey on 240 subjects has been analyzed. The results reveal significant 
differences in program preferences between occupational groups. These 
preferences are reflected in the preference for British Broadcasting 
) Company station programs over French and other station programs | 
carrying popularized advertising programs similar to the main American 
network programs. The limitations of space and the make-up of this 
issue have made it impossible to publish these results here. A detailed 
analysis will, however, be published in the near future. 


W. O’D. Pierce 

















NEWS AND NOTES 


The Midwestern Psychological Association will hold its annual meeting 
at the University of Nebraska, Lincoln, Nebraska, on May 5 and 6, 1939, 
under the presidency of Dr. E. S. Conklin of Indiana University. The 
title of Dr. Conklin’s presidential address will be ‘‘The Status of Aca- 
demic Psychology.’’ A special feature of the meeting will be the com- 
memoration of the fiftieth anniversary of the founding of the psycho- 
logical laboratory at the University of Nebraska, one of America’s earliest, 

by Harry Kirke Wolfe. 


The 1938 volume of the Occupational Index, complete with cumulative 
subject, author, and title indexes, is now available. It contains 1,751 new 
references to literature on 300 different occupations. The price is $6.50. 
Further information may be obtained from the National Occupational 
Conferences, 551 Fifth Avenue, New York. 


A new Bureau of Instructional Research has recently been created at 
the University of Nebraska, with J. P. Guilford, professor of Psychology, 
as Director. Professor Guilford will continue to devote part of his time 
to teaching. Mr. H. M. Cox, of the University of Georgia, has been 
appointed to full-time work in the Bureau. 


A course in the application of the Rorschach Method will be offered by 
Dr. 8. J. Beck at Michael Reese Hospital, Chicago, Illinois, May 15-20. 
For further information write to the Librarian, Michael Reese Hospital. 

Tentative plans are also being made for a similar ten-day course to be 
offered later in the summer. The dates will be arranged to meet the con- 
venience of prospective registrants. Interested persons having preference 
as to date of application are invited to communicate with the Librarian, 
Michael Reese Hospital. 

The need and methods for guidance and adjustment of young people to 
their work and life objectives will be the central theme for the annual 
convention of the American Council of Guidance and Personnel Associa- 
tions in Cleveland, February 22 to 25, Prominent among the member 
associations holding annual meetings during the three days following an 
all-day program under Council auspices on February 22 include the Na- 
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tional Association of Deans of Women, the National Vocational Guidance 
Association, American College Personnel Association, Personnal Research 
Federation, Teachers College Personnel Association and Western Person- 
nel Service. The meetings will be held at Hotel Cleveland, with the open- 
ing session to be addressed by Ernest O. Melby, Dean, School of Educa- 
tion, Northwestern University, and Edwin DeS. Brunner, Teachers College, 
Columbia University. 


To promote a spirit of religious and racial tolerance and understanding 
among the people of the United States, the Office of Education with the 
cooperation of the Columbia Broadcasting System and the Service Bureau 
for Intercultural Education, has launched a series of twenty-six nation- 
wide broadcasts, ‘‘ Americans All—Immigrants All,’’ to show the great 
contributions which men and women of various races and nationalities 
have brought to our country. The first program, presented on January 15, 
was devoted to the contributions of the German nation which has sent 
more immigrants to the United States than any other. The second pro- 
gram entitled ‘‘ Jews in the United States,’’ was presented on February 5. 
Organized education in the United States is challenged to prove its value 
as a democratizer. The New York City Board of Education is to be con- 
gratulated on its recent action to promote school assemblies and instrue- 
tion in general leading to racial and religious tolerance. It is the hope 
of the United States Office of Education that school boards throughout 
the nation will take similar definite action in strengihening the defenses 
of our democratic ideas and practices against the inroads of those doc- 
trines which are so thoroughly opposed to those of our nation. The Office 
of Education announces that each program will be recorded and that 
within a short time will be made available both for publie address systems 
and phonograph use. 


The Carnegie Foundation for the Advancement of Teaching has recently 
issued its Thirty-Third Annual Report of the President and Treasurer for 
the year ending June 30, 1938. Dr. William 8. Learned, in charge of the 
Foundation’s Pennsylvania studies, believes that an unjustifiably large 
proportion of American college students are misfits. Of withdrawals from 
college, ‘‘the largest single group was eliminated by faculty action on 
academic deficiency. The second largest group falls in that unexplored 
category ‘reason unknown.’ ’’ The reasons given are very often super- 
ficial and the problem of learning the causes of the essential dissatisfac- 
tion which led to withdrawal is yet to be solved. Dr. W. Carson Ryan, Jr., 
staff associate, discusses early graduate education in America with special 
reference to The Johns Hopkins University, Clark University, and the 
University of Chicago. ‘‘The emphasis upon research in the ventures at 
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Baltimore, Worcester, and Chicago can hardly be understood unless the 
vitalizing, creative quality of the work in these pioneering places is kept 
in mind.’’ In the early history of all three of these institutions there are 
elements of value for higher education today, especially at the graduate 
level, Dr. Ryan believes. Beginning early in 1937, the Carnegie Founda- 
tion undertook to explore new procedures for successful graduate study. 
The graduate schools of Harvard, Yale, Princeton, Columbia, and Brown 
are cooperating with the Foundation in this inquiry, which is under the 
direction of Dr. William 8. Learned. The results of the study will be 
important not alone to the graduate schools but especially to those stu- 
dents who desire to take graduate work and who, by the individual results, 
may gauge their own capabilities more surely. From 1924 to June 30, 
1938, Carnegie Corporation of New York has made to the Carnegie Foun- 
dation for the Advancement of Teaching 137 grants totaling $1,307,543 
for 82 projects pertaining to the field of higher education. Of these proj- 
ects fourteen, involving $328,543 in 30 grants, have been carried on in 
the offices of the Foundation, while 68 have been carried on under the aus- 
pices of 39 other educational institutions or bodies. During the fiscal 
year 1937-38, 36 of these projects were going forward. Grants paid 
during the year totaled $113,000. 
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Hersert Moore. Psychology for Business and Industry. New York: 
McGraw-Hill, 1939. Pp. xi+527. 

This book is the most recent addition to the many that have been put- 
lished on the psychology of business and industry. Although this work is 
not divided into sections, all of the chapters fall under one of these head- 
ings—employment psychology, the psychology of efficiency, and the psy- 
chology of selling and advertising. 

A number of the chapters concern employment psychology. The author 
describes getting a job, and the importance of proper selection. He then 
discusses hiring the worker, where he reviews the application blank, the 
letter of recommendation, the photograph, and the interview as selection 
aids. Tests for selection are evaluated in the following chapter. Dr. 
Moore then has chapters on the introduction and construction of tests, and 
job analysis and specification. 

There are six chapters that might well be grouped under the psychology 
of efficiency. The first of these concerns promoting the employee, and 
tells of the nature and importance of promotion plans, methods the em- 
ployer can use in determining promotions, how the employee can secure 
promotions, ete. The next chapter presents material on training the 
worker, and is followed by a chapter on motivation in industry. Employee 
accidents are discussed in another chapter, and a chapter on fatigue fol- 
lows. A chapter is also devoted to the problem employee in industry. 

The last two chapters in the book concern the psychology of distribution. 
The psychological problems in advertising comprise one chapter, which is 
followed by a chapter on psychological problems in selling. 

The presentation of the material is a mixture of the academic and the 
practical. Dr. Moore writes in a style that is a little difficult to follow, 
in some instances. Each chapter is divided into sections, and the sub- 
heads under each of these sections are carefully numbered, in the academic 
tradition. This, of course, does aid considerably in grasping the material. 

The material presented is all highly practical. Dr. Moore does not, for 
example, review studies that predict success in typewriting; employers 
never hire a person with the idea of teaching him to type. Instead, typists 
for business are selected on the basis of how well they can type at the time, 
so only tests for the measurement of typing proficiency are deseribed. Dr. 
Moore is careful to select material throughout the book with the same cri- 
terion of practical use in industry in mind. 
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The book summarizes most of the recent literature pertaining to indus- 
trial psychology. In discussing some of the work, Dr. Moore takes a quite 
critical attitude, which seems highly desirable, but results of other experi- 
ments are merely presented with little or no comment. The greatest de- 
fect of the book seems to be that Dr. Moore doesn’t express his own 
opinion often enough. 
The work appears to be designed frankly for students, rather than for 
persons in industry. If this is the case, Dr. Moore might have devoted a 
few chapters to a discussion of individual differences, in order to provide 
students with the information basic to applied psychology. With this one 
exception, the book is unusually complete in scope. 
Questions at the end of each chapter are included to help the student. 
Another desirable feature is Dr. Moore’s habit of giving 2 convenient and 
complete reference to all work cited in the book. 
The book should definitely be an aid to those teaching business and in- 
dustrial psychology. The applied psychologist should read it so as to get 
a new ‘‘slant’’ on certain of the topics. 
ALBERT B. BLANKENSHIP, 
Psychological Corporation. 


C. SpzarMAN. Psychology Down the Ages. London: Macmillan, 1938. 
2 vols., pp. 742. 

A misleading title frequently causes confusion in the minds of readers 
and the title of the present work would denote to the casual book-gazer 
** just another history’’ of the science of psychology. This is emphati- 
cally just what the book is not. It is, on the contrary, a representation 
of the development of concepts of mental activity from earliest time to the 
present, and Professor Spearman demolishes, with ease in many instances, 
any thought that psychological investigations have developed new or 
startling ideas, or that real scientific progress has been made in the past 
several thousand years. 

The first volume is concerned largely with preliminary considerations of 
the psyche, what powers it possesses and how it is constituted. The ap- 
proach is, of necessity, largely from philosophy, since each constituent or 
recognized power is considered from its character as recognized by primi- 
tive man, the Greek philosophers and the latter day philosophers, each of 
whom has puzzled over and had something to say about mental activity. 
Professor Spearman brings to his discussion a mixture of frank admira- 
tion for the keen thinking of the Greek teachers, recognition of the advan- 
tages of the common sense point of view of the layman, and a sharp ruth- 
lessness toward the confused thinking of the modern psychologist. He is 
particularly bitter toward what he calls ‘‘the confusion that is Gestalt 
psychology,’’ and holds no brief for behaviorism since it eliminates com- 
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pletely that which Professor Spearman holds most dear, the study of the 
psyche. In his discussion of the mental constitution, Professor Spearman 
continues the classification and terminology used in his previous books, 
cognition and orexis. Any one familiar with the Nature of Intelligence 
and The Abilities of Man will no doubt feel that the author has exempli- 
fied his own tenet that there is nothing new under the sun, for the present 
volumes are an amplification of these others with reference to the philo- 
sophiical background of the present British school. 

By way of general discussion, it would seem well to mention that in 
spite of the author’s optimistic view that the book will make psychology 
clear to the average reader, he has made a serious error in the inclusion 
of a multitude of Greek terms which are probably totally unfamiliar to 
many readers in this country. This is particularly true in the first volume 
and tends to spoil the otherwise clear style and presentation. 

In the second volume Professor Spearman has approached more nearly 
the level of the average reader. The need for universal laws of psychol- 
ogy and what laws have been developed in psychology are thoroughly con- 
sidered here. The influence of associationism is very marked throughout 
and the laws of mental sequence as recognized by Spearman are in final 
form classified as: I. Primitive states; Il. Cognitive quality, (1) Knowl- 
edge of experience, (2) Knowledge of relations, (3) Conception of corre- 
lates; III. Orectie quality, (1) Impulse, (2) Will; IV. Quantity, (1) 
Output, (2) Control, (3) Retentivity, (4) Fatigue, (5) Basal conditions 
(body-mind). The laws of cognitive quality are Spearman’s own noe- 
genesis, familiar as the substratum upon which the two-factor theory is 
founded. 

The two-factor theory itself comes in for consideration in the final sec- 
tion of the book. Much of the controversy which has been raging over 
factor-analysis is considered but Professor Spearman feels that the statis- 
tieal technique is continuing to make progress in clarifying our knowledge 
of ‘‘what goes with what’’ in mental activity. 

No one could deny that Psychology Down the Ages is an erudite and 
scholarly work, but it is disappointing in that its place in psychological 
literature is perforce less significant than one had hoped. For the aver- 
age reader or the student it is too complex, too unwieldy and includes too 
many references to minor philosophical doctrines; for the scholar who is 
already familiar with Professor Spearman’s theories and point of view it 
brings forth little that is novel. It is not easily used as a reference book 
because of its peculiar organization. The documentation is in the form 
of brief notes at the end of the volume which are frequently too frag- 
mentary to be helpful, and in many cases authors are mentioned in the 
text without corresponding reference in the notes. 

K. W. Onegin, 
University of Delaware. 
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Pryns Hopxivs. The Psychology of Social Movements. London: 
George Allen and Unwin, 1938. 

This book by the Chairman of the British Psychological Research Com- 
mittee of the New Commonwealth Institute typifies the tremendous im- 
provement in social psychology which has been going on for the last ten 
years. Dr. Hopkins has given a far more satisfactory interpretation from 
the psychological point of view of the major social activities of man than 
most so-called treatises on social psychology have offered. 

The treatment is organized around six ‘‘needs’’ of mankind which he 
lists as: knowledge, sensory naturalism, inner peace, the family, material 
means, and safety from violence. While this list of needs differs in its 
mode of formulation from most of the others with which we are familiar, 
it covers the same ground as our familiar lists of drives or motives. 

The approach throughout is psychoanalytic and tends to follow the 
Freudian point of view. In this respect it is, perhaps, unfortunate that 
Dr. Hopkins was not in closer touch with some of the trends in psycho- 
analytic thinking exemplified by such analysts as Karen Horney. I be- 
lieve that many modern analysts have come to realize the cultural deter- 
mination of some of these needs which have been considered innate by 
earlier workers in this field. 

I was particularly interested in Dr. Hopkins’ treatment of the problem 
of war. He lists the following motives as being involved in the deter- 
mination of man’s willingness to fight: first, narcissism, or the tendency 
to get self-satisfaction from the power of the nation; second, exhibition- 
ism, which is appealed to by uniforms, parades, ete.; third, allo-erotism— 
that is, satisfaction from being with large numbers of people of the same 
sex in free, uninhibited activity; fourth, hetero-sexuality (Hopkins points 
out that most wars are fought to protect our women; we might add that 
soldiers generally have extra sexual privileges); and, fifth, the Oedipus 
complex—the familiar family conflict of the child’s relations with its 
parents. Hopkins suggests that repressed antagonism from intra-family 
difficulties may be projected against the enemy nation and thus given free 
expression. Certainly this treatment of motives for fighting is much more 
sensible than many of the other pseudo-interpretations which have been 
offered. 

On the other hand, there seems to be an essential defect in the logic of 
this analysis in that the author does not explain why certain motives may 
lead either to militarism or to pacifism. He points out, for example, that 
the soldier may be sublimating an Oedipus complex, or that a militant 
pacifist may be reacting to the same impulse. Now, if the Oedipus com- 
plex is offered as an explanation of both of these, I should be inclined to 
say that it does not explain either. We must still seek for some explana- 
tion of the intense difference between these two individuals. 
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I think the author gets at a very fundamental point when he comments 
(page 116), ‘‘ Peace will never be secure until the peoples of the world 
have scrapped the antiquated machinery called nationalism, and organized 
the world under an international equity tribunal, pooling their rival arma- 
ments in a single, democratically controlled world police force.’’ I should 
have liked to see this point much more carefully elaborated from the point 
of view of the psychological needs which are satisfied by nationalism. 

I also find some difficulty in Hopkins’ treatment of ownership. He 
gives the customary Freudian interpretation of acquisitiveness and the 
desire for possession in terms of anal-erotic impulses. This interpretation 
has become more or less traditional aad, no doubt, with sound justification 
in some cases, On the other hand, Hopkins points to Karl Marx as a typi- 
eal anal-erotic. If Karl Marx and Andrew Carnegie have the same basic 
dynamisms, it seems to me that psychology has not done an adequate job 
of explaining the tremendous differences between these two individuals. 

I should say that Dr. Hopkins tends to ignore, or at least to miss in 
certain crucial cases, the importance of the particular individual with 
whom the child identifies himself. I think that a consideration of this 
phenomenon of identification might have clarified some of the problems 
which he discusses. 

The book has certain very obvious defects, particularly in the distribu- 
tion of space. The anti-tobacco movement, which is not an important 
social movement in America, whatever it may be in England, receives two 
full chapters, whereas socialism, corumunism, and fascism receive only gen- 
eral mention. Typical of this is the fact that in the index we find smok- 
ing receiving fifteen references, war four, socialism six, fascism three, 
communism four, and capitalism two. Offhand, I would say that any one 
of these is more important than the problem of smoking. 

The author’s treatment of lynching is one which is particularly inter- 
esting to Americans. Dr. Hopkins lived for some years in this country, 
and is familiar with this particular custom of Americans. His emphasis 
upon the réle of sadism in connection with lynching is undoubtedly justi- 
fied. Here again, however, I should be inclined to inquire whether pure 
sadism is an adequate explanation. Why is it that this sadism breaks out 
in the form of lynching at times when the dominance of the white race is 
threatened? In southern communities where negroes are completely sub- 
missive lynching is very rare. We ought to inquire, then, not only what 
elements go to determine the specific activities of social movements, but 
also those fundamental dynamic qualities which set off the activities at 
particular times and not at others. 

The author shows a tendency, which is rather surprising for an orthodox 
psychoanalyst, to quote dream interpretations which have, apparently, 
been made from letters without personal contact with the subject. My 
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own experience with dream interpretations would suggest that this cannot 
be successfully handled as a mail order business, and, while I am not in a 
position to state that the interpretations given by Dr. Hopkins are incor- 
rect, I think it indicates a somewhat careless mode of approach to this 
very difficult problem. 

if this review seems to concentrate upon the uudesirable qualities of Dr. 
Hopkins’ book, it is probably because I hoped for too much when I began 
to read it. Certainly, psychology is desperately in need of a thorough, 
systemxtic interpretation of social problems. I should unhesitatingly 
place Dr. Hopkins’ book among the very first which I would recommend 
that psychologists read if they are interested in trying to orient their 
thinking toward social problems. It is a book which ought to be required 
reading in courses in social psychology. While the emphasis upon psycho- 
analysis will be too strong to please many Americans, it is generally sound 
and much more readable than a great many other contributions in this 
field. Certainly, its good points far outweigh any of these minor defi- 
ciencies to which I have called attention. 

Ross STAGNER, 
Unwwersity of Akron. 


C. E. SzasHore. Psychology of Music. New York: McGraw-Hill, 1938. 
Pp. xix+408. $4.00. 

This book is a testimonial to the program of research work in the psy- 
chology of music which the author has carried on for the past forty years. 
It is not intended as a comprehensive account of the whole subject, for 
the works of numerous other investigators are not mentioned, but it is in- 
stead a complementary record of the field from the special point of view 
of one who has done more than any other investigator in calling attention 
to this important subject. 

Those whose primary interest is in the acoustics of music will find the 
volume admirable. Stated physically, music is largely an acoustical affair 
and there is much justification in attempting to explain music on this 
basis as the author has done, largely because the four attributes of sound 
ean be accurately measured, but it will not be very convincing or fruitful 
to the musician. The attempt is logical, interesting, and scientific, but 
the results are disappointing. Perhaps we have a partial answer in the 
fact that most, but not all, of the questions which initiated the various 
investigations upon which the volume is based, were not musically mean- 
ingful and that further use of the acoustical method with insightful in- 
quiries will justify the author’s ‘‘scientific approach’’ to the psychology 
of music. 

The book is a sequel to The Psychology of Musical Talent published in 
1919, ‘‘which has permanent value and should, therefore, not be revised, 
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but supplemented’’ (p. x). Faith in the atomistic nature of the musical 
mind, dependent mainly upon sensory discrimination, is reaffirmed with 
no modification even though every statistical analysis, including those 
originating from within and those from without the Iowa Laboratory, has 
shown the possibility, if not the necessity, for some change of emphasis. 
This is particularly true with the test of tonal memory which has consis- 
tently held the highest position for validity in all investigations, and yet 
it cannot be explained within the framework of the author’s acoustical 
analysis theory. Sixteen of the twenty-eight chapters are reprints or 
abstracts of articles written or edited by the author from 1913 to 1937. 

New material includes a considerable amount of good work with timbre ; 
the musical performance score (photographic and mechanical recording 
of pitch, time, and intensity from actual or phonographie performances) 
for voice, piano, and violin; guidance; a method for studying primitive 
music; and applied musical aids. The musical performance score is a 
method which makes possible a detailed study of factors of interpretation 
based on pitch, intensity, and duration and their interrelationships. Pro- 
vided queries which have musical significance are posited, this method may 
prove to be a contribution of no mean value. Its possibilities have already 
been shown in several preliminary studies which have given systematic 
measurements somewhat similar to exhaustively measuring the hundreds 
of parts of an automobile, some of which are valuable and others which 
seem to be impossible of utilization. 

That the author believes there is enough scientific data available for 
effective guidance in music is suggested from, ‘‘Some of the most pitiful 
failures in musical careers are not due to lack of musical ability but to 
a misguided effort, as when the lyric singer attempts to become an opera 
star or vice versa, when a highly gifted pianist attempts to become a vio- 
linist for which he may not be fitted, or when one whose natural outlet is 
in musical performance enters the field of creative writing. Fortunately, 
nature often takes care of such adjustments through natural cravings; 
but a critical review of the personnel in the musical world on this issue 
reveals disheartening results of misplacement which could have been fore- 
stalled by modern guidance at early stages’’ (p. 297). In view of the 
fact that no studies have ever been reported showing the validity of any 
test, or battery of tests for this purpose, and further, in view of the pool- 
ing procedure employed by Stanton in the Eastman Experiment, under the 
author’s guidance, where not only all six tests were added to make a com- 
posite score but an intelligence test was also included in the composite so 
that no evaluation could be made of individual tests, this account of the 
present status of musical guidance is more than optimistic. 

Under the chapter on ‘‘The Development of Musical Skills’’ one is 
given the suggestion of the great possibilities that the psychologist may 














BOOK REVIEWS 217 


some time be able to achieve in supplying the musician with aids to devel- 
oping skills. The tonoscope can be used by the violin or voice student to 
determine the accuracy of his intonation, visually. The difficulty at pres- 
ent, however, is the expense of the instrument and its inflexibility in a 
natural situation of teaching or practicing. If a perfected instrument 
could be produced, the musical teaching profession as well as students and 
those who cannot get out of range of practice rooms, would be forever 
debtors to the inventor. Somewhat the same may be said of the intensity 
meter, the rhythm meter, and the cathode ray oscillograph for measuring 
timbre. The pioneering work of the author in developing some of these 
instruments, particularly the tonoscope and the rhythm meter, and in 
pointing out the potentialities of others is, in the reviewer’s opinion, one 
of his outstanding contributions. 

To the musician, to whom a Psychology of Music should be dedicated, 
as the author does by saying, ‘‘The purpose of this book is to stimulate 
and guide the student of music ...’’ (p. x), there will, unfortunately, 
be little which will either help or appeal to him; he may even wonder if 
its title is a misnomer from both a musical and psychological viewpoint, 
and that Jean’s title, Science and Music, would have been more appropri- 
ate. For this reason it can hardly be considered as a desirable text; it is 
a much better research manual. This, however, does not keep the book 
from being a real contribution, for it cannot always be predicted what the 
outcome of a certain approach will be and to determine empirically its 
weakness is 2 service to others who may take advantage of this knowledge 
and use it for the advancement of the subject. There can be no doubt 
that the author must be credited with initiating and pursuing longer than 
any other, one of the most important fields of investigation in the whole 
realm of psychology. Although so far science has contributed little to 
music we can be grateful for the valuable preliminary work which has 
been done so well by Dr. Seashore and his numerous associates. 

RALEIGH M. DRAKE, 
Wesleyan College, Macon, Ga. 
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